Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Hello all (and, if you are watching these posts, Databricks employees/representatives ),I hope you take this idea into account - I haven't been able to find a place where one can vote on features, but I believe that this idea would make very real im...
Hi @QueryingQuagga , We always appreciate feature requests! If you are working with an account team, you can always pass this information along to them, they have the ability to submit feature requests and vote on existing feature requests as well. I...
I am attempting to create a Vizro dashboard in a databricks notebook. I have validated that the code to generate dashboard works is accessible when running the notebook on my local machine. However, when attempting to compile the dashboard on a datab...
This issue is common when attempting to run interactive dashboards (such as Vizro or Plotly Dash) within Databricks notebooks; many users face the "This site can't be reached" message because the dashboard tries to launch a local web server on an add...
I'm relatively new to Databricks and Spark and have decided to create a Spark cluster with AWS under the free 14 day trial.The JSON to the cluster is as follows:{"data_security_mode": "DATA_SECURITY_MODE_DEDICATED","single_user_name": "me@gmail.com",...
Hi @neesam, while the command is hanging, check the driver logs from the cluster page to see if they provide any clues about what might be causing this issue.
I was trying to install a personalized .whl file located in the "shared" folder but I'm obtaining this error:org.apache.spark.SparkException: Process List(/bin/su, libraries, -c, bash /local_disk0/.ephemeral_nfs/cluster_libraries/python/python_start_...
The error indicates a permissions issue when trying to install your custom .whl file from the "Shared" folder in Databricks using dbx and Spark. Specifically, the error [Errno 1] Operation not permitted suggests the process does not have the required...
I recently updated my Databricks VS Code extension from version 1.4.0 to 2.4.0. After the update, I noticed that:The "Configure Sync Destination" button is missing.The sync destination format has changed to a remote folder instead of the previous set...
The upgrade to Databricks VS Code extension v2.4.0 changed the sync destination system from the previous workspace directory setup, removing the "Configure Sync Destination" button and setting the default to a more rigid remote folder structure (comm...
Hi,We publish listings on the Databricks Marketplace.Several times a week, we receive a lead notification stating: "db sp has installed 'Etsy Dataset'."It’s always the same dataset and the same name, so it’s likely a technical error.Does anyone know ...
Yes, this is a known issue reported by other Databricks Marketplace publishers: receiving frequent lead notifications stating "db sp has installed 'Etsy Dataset'" for the same dataset and name, which suggests an underlying technical error in the lead...
We are trying to schedule updates to streaming tables and materialized views in Azure Databricks that we have defined in dbt.Two options we are considering are `SCHEDULE CRON` and just scheduling `dbt run` commands via CI/CD. The `SCHEDULE CRON` opti...
Your understanding of the trade-offs between using SCHEDULE CRON on streaming tables/materialized views and the dbt run orchestration in Azure Databricks is largely correct, and you’ve identified the two main pain points: orchestration of dependencie...
We recently enabled the preview feature to refresh power bi datasets from data bricks workflow, but when we run the job data changes aren't being applied despite a completed status in refresh history. Could anyone clarify whether this is intended pre...
This is a known issue with the Power BI/Databricks integration preview for refreshing Power BI datasets from Databricks workflows. Even when a job completes and the refresh history shows success, actual data changes—such as newly inserted rows—are of...
I would like to be able to express something like: WHERE columnA = "valueA" OR columnB = "valueB" but on the Widget. I only see the possibility that chaining filters that are processed as AND operator. Am I missing something?
Most widget filter interfaces only support multiple filters using an AND operator, meaning each condition must be true for a row to be included. If you want to use an OR operator, such as filtering where columnA = "valueA" OR columnB = "valueB", most...
Hello communityI am facing an issue when I export a dashboard to an HTML: the problem is that the HTML has white background but the exported tables have black colors, like the example I am showing below Does someone know how to handle this visualizat...
To resolve the issue of dashboard tables exporting to HTML with mismatched colors—specifically black table backgrounds against a white HTML page—review and adjust your dashboard’s CSS or formatting settings before export. The problem typically occurs...
Hi all, I need to add a shortcut key for R's pip operator (%>%) to my Databricks notebook. I want the operator to be written in my code snippet when I hold down the shortcut keys (shift + ctrl + m). Is there a straightforward way to add such shortcut...
Databricks notebooks do not natively support defining custom keyboard shortcuts to insert specific code snippets like R’s pipe operator () within the notebook editor UI. The list of standard shortcuts available is limited to navigation, cell manageme...
Hi all!Need help configuring ODBC connection on a Mac. I'm receiving the error "The web server failed to start, please verify if port 8020 is being used by another connection or annother application".I've downloaded and installed Databricks ODBC con...
The error "The web server failed to start, please verify if port 8020 is being used by another connection or another application" when configuring an ODBC connection to Databricks on a Mac, even after checking that port 8020 is not in use, is a known...
Hi All,How can I maintain 7 years of transactional data in delta table? Can I have log retention of 7 days, but data retention of 7 years?Appreciate your response.Thanks and regards Suhas
Hi @patilsuhasv,Maintaining 7 years of transactional data in a Delta Lake table is technically possible, but it requires careful configuration — and it’s important to understand the recent changes Databricks announced (effective December 2025) regard...
hi everyone, does somebody have experience with connecting PowerBI to SAP Databricks in the BDC? I have quite a few SAP customers interested in that ... many thanks, Andreas
Hi @WiliamRosa ,do you know which feature is missing in SAP Databricks that it doesnt work? As Andreas said- everybody is asking that question.KR Daniel
As part of a function I create df1 and df2 and aim to stack them and output the results. But the results do not display within the function, nor if I output the results and display after.results = df1.unionByName(df2, allowMissingColumns=False)displ...
Hello @CEH! Did any of the suggestions above help resolve the issue?If so, please mark the most helpful reply as the accepted solution. Or, if you found another fix, please share it with the community so others can benefit as well.
