Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.
Keynote: Data Warehouse presente...
Hi!I try to connect to an azure databricks sql warehouse in dbeaver, which uses the azure databricks jdbc driver version 2.7.1 ## and I cannot get M2M authentication to work. I get a 'Not Authorized' (401) response when I try to connect, and it seems...
Hi @jakobhaggstrom, this error likely occurs due to the type of secret you're using. For M2M authentication, the Databricks JDBC driver requires a Databricks generated OAuth secret, not a Microsoft Entra ID client secret. While your service principal...
We work with a application that connects to our Databricks serverless SQL warehouse via Databricks JDBC driver. It runs a few thousand SQL select statements everyday, and a small percentage of them will fail with the following error details: java.sql...
Application connects to Databricks serverless SQL warehouse via Databricks JDBC driver. It executes SQL select statements only. We see small number of statements failed each day with the following error detail: java.sql.SQLException: [Databricks][JDB...
Hi,I am trying to install UCX for Databricks workspace using the Databricks CLI. When I attempt to install a specific older version instead of the latest, I get a dashboard creation error. This seems to be due to the April 7 update, which removed the...
Hello @meghana_tulla!
Older versions of UCX may fail to install because they try to create legacy dashboards, which are no longer supported following the April 7 update. To work around this, make sure your Databricks environment is aligned with the l...
Hi everyone,I'm currently setting up access controls in our Databricks development workspace. The goal is to enable business users to explore data and build their SQL skills within the workspace itself (e.g., via SQL editor or notebooks), but prevent...
Enable Workspace-Only Access to SQL Warehouses (Serverless or Classic)If you're using Serverless SQL Warehouses, or even Classic, you can restrict them to workspace access only:1.Only notebooks, dashboards, and SQL editor can connect.2.External JDBC/...
Hello All, We want to update our postgres tables from our spark structured streaming workflow on Databricks. We are using foreachbatch utility to write to this sink. I want to understand an optimized way to do this at near real time latency avoidi...
In a Databricks AI/BI dashboard, I have a field with multiple categories (e.g., district-wise sales with 50 districts). How can I display only the top few categories (like the top 10) based on a specific metric such as sales?
Hi Databricks Community,I'm trying to understand which team is responsible for maintaining the Databricks Connector for Looker Studio . We’re currently facing a major performance bottleneck with how this connector operates.Specifically:The connector ...
Thank you for the feedback!
Unfortunately there is a limitation in Looker Studio Community Connector API. getData method does not specify aggregation expectations for the data source. Therefore, a connector is expected to retrieve non-aggregated resu...
Hi!I have a multi-page dashboard based on a handful of tables sharing a common run_id field.I created a dropdown filter widget on the first page to filter datasets based on the table's run_id field.It worked fine for this page, but how to reuse it fo...
Hi everyone,We are having an issue using parameters with EXECUTE IMMEDIATE statements, when running on SQL serverless running DBSQL v2025.15 (currently in preview channel):declare or replace var query = "SELECT :PARAMETER_1";
EXECUTE IMMEDIATE query;...
Hello All,I wanted to touch base regarding the training and tool for Bladebridge Analyzer that we currently have access to. This has been quite useful in understanding and showcasing its capabilities to our customers.However, as we move forward, we a...
Hi @Vasu_Kumar_T, Did you try the course mentioned on this page: https://www.databricks.com/blog/welcoming-bladebridge-databricks-accelerating-data-warehouse-migrations-lakehouseIf you are a Databricks partner, you can access BladeBridge migration tr...
I am going through the labs for the CDW Migration Best Practices training on the Databricks Learning Portal and scored 75%. However, it still shows as "In Progress."Can anyone explain the criteria for marking the labs as complete? Do I need a higher ...
Hello,I'm trying to finish Delivery Specialization: CDW Migration Best Practices course but I could able to achieve only 50%.could you please share those answer notebooks to this email "betterahyosi2k20@gmail.com" ???
Hi,Does anyone knows how to create Pareto plot on databricks lakeview dashboard? My stakeholder would really like to see this display on the dashboard. I'm able to get the values on a bar chart and create a cumulative percentage variable, but when I'...
I do not have any handy. A bit of research on your part might get you what you need. Also, the recommendations to embed in Lakeview refers to embedding a static image of your chart in Lakeview dashboards. You cannot integrate third party tools in ...
I have built a class which is already over 2.5k code lines.It is extremelly painfull have to scroll a lot once you need something you know it on the bottom. I have looked after a solution to set the collapse as a default but could not find.Has anyone...