Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
I created an iceberg table within databricks and shared it via delta sharing with tokenThen I use curl command to access it with iceberg endpoint like this:curl -X GET \-H "Authorization: Bearer ***"\-H "Accept: application/json" \"https://ohio.cloud...
Thank you @rdokala , @aleksandra_ch BTW, can I share managed uniformed delta table to external Iceberg clients? I tried this but get the same error, my friend tried, seems fine. I don't know what's the difference.Best regards,Li
We have noticed that users can schedule SQL queries, but currently we haven't found a way to find these scheduled queries (this does not show up in the jobs workplane). Therefore, we don't know that people scheduled this. The only way is to look at t...
We ran into a similar governance concern and looked at it from both a prevention and a monitoring perspective.From what we've seen, scheduled SQL queries are different from the traditional Jobs that users create in the Jobs UI, which makes them harde...
I have two Databricks Apps that show RUNNING status and clean deployment logs, but both return 502 Bad Gateway when accessing their public URLs. Error: Both apps return "502 Bad Gateway" when accessed via their public URLs.Troubleshooting Attempted:-...
Hi Julie,Host or port binding mismatch between your Streamlit application and the reverse proxy is likely. Even though the app container starts up and reports RUNNING status, the platform expects the internal server process to listen on 0.0.0.0 and b...
Setup: Lakeflow Connect Netsuite pipeline (UC Connection, deployed via UI), Azure Databricks. Target table is netsuite.transactionline, currently about 13.8M rows, 395 columns, CDC ingestion type (I know I know but there aren't that many rows changin...
I'm working on Databricks AI/BI dashboard containing a native visualization; to achieve custom styling such as progress bars, the dataset SQL Generates HTML strings using expressions similar to:CONCAT( '<div style="...">', CAST(value AS STRING), '</d...
Adding one option on top of the two-column approach above: depending on how attached you are to the exact progress-bar look, you may not need hand-rolled HTML at all anymore.Table visualizations in AI/BI dashboards picked up richer native formatting ...
Hi,I'm experiencing an issue with Visual Data Prep where some source tables appear to contain fewer rows than expected.When I query the same tables directly using SQL, I can see all records. However, when loading certain tables into Visual Data Prep ...
Hi dax60,What you are seeing comes down to the difference between processing limits and UI rendering limits in Visual Data Prep. When you set Rows scanned to Max you are instructing the engine to process all records from the source table for your int...
In databricks documentation it says that there's a display name when creating dashboard variables but I'm not seeing it in the dashboard settings. Does anyone know where to find them?
Hi @amekojc, We have fixed the documentation to reflect the current behaviour. Please watch the space for the specific feature you were looking for.
Hello everyone,I am using a DAB to send a dashboard snapshots to notification destinations.The intended design is to use a For each task for multiple team/destination pairs. As a minimal test, I am iterating over an array containing one notification ...
dashboard_task.subscription.subscribers[].destination_id does not appear to support Lakeflow dynamic value references such as {{input}} or {{input.destination_id}}. Public docs show dynamic values for For each inputs and nested task parameters, and d...
I have a requirement to build a custom designed quality dashboard in dbx. The requirement is like user have to view the quality of data metrics in a single dahsboard for many tables, irrespective of viewing it via inbuilt data quality option availabl...
Hi @Databricks2206, For us we have try a couple of approachesOption 1: DQX (Databricks Labs Data Quality Framework) - this is purpose-built for what you're describing. It ships a pre-built dashboard with three tabs, including a "Data Quality Summary"...
I would like to be able to add columns to this overview, if possible. For example, the latency of the model is available, when I click on a run, but I would like to see the average latency, similarly to, how the score is shown. Of course, I could add...
I don’t think the evaluation runs overview currently supports adding custom columns or directly displaying existing metrics like latency percentiles/medians. The usual workaround is to create custom scores or export the evaluation data and analyze it...
Hello community of DatabricksI need some help over a specific issue in AI/BI Dashboard filteringMy current dashboard has 2 widgets:- A map containing the shopID and it's current GPS location- A table showing all the available shopID with some metadat...
Table widgets in AI/BI dashboards don't support cross-filtering, that's what's tripping you up. Click-to-filter currently only works for bar, box plot, heatmap, histogram, pie, scatter, and point map visualizations. A plain table isn't in that list, ...
We are looking to create a Genie usage report covering natural language querying activity across three channels — the Genie One web app, Genie One Teams app, and Genie One mobile app. The report is intended to surface insights around user activity, q...
1. Is there a system table for this today? Answer: not as a single supported system table. Databricks system tables currently give you usage/billing, audit events, and executed SQL history, but not a complete per-message record containing the origina...
Hi Team, I have analysts set up in Databricks with the "Databricks SQL access" entitlement who are no longer able to create a new Dashboard on their own and just getting a blank page when they try. The API response to their create dashboard request i...
Hello, Thank you both for your responses. @Ashwin_DSA, I had an analyst test again and they were able to create a dashboard; looks like the hotfix worked. Thank you for your team's prompt attention to this matter. Sincerely, Matthew
Hi everyone,I have a question about the best practice for organizing Databricks Asset Bundles.I have multiple projects, and each project has its own notebooks and jobs.Is it recommended to:create a single bundle that includes all projects, orcreate a...
You can create Bundles that are decoupled by domain, managed via multi target declarations within configuration and also driven by immutable, versioned artifacts stored securely within Unity Catalog Volumes. You can rely on explicit CI/CD gating and ...
Hi @Hubert-Dudek I am getting following error: METRIC_VIEW_WINDOW_FUNCTION_NOT _SUPPORTED The metric view is not allowed to use window function (...) With the following definition:- name: Sales net Total- expr: SUM(MEASURE(`Sales net`)) OVER())Howeve...
The error occurs as nesting a window measure inside another window measure exceeds the functional boundaries
