Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Hi everyone,We currently use CI/CD (Databricks Asset Bundles + Git) for deploying notebooks, jobs and pipelines across DEV and PROD.However, we also have frequent ad-hoc requests from business teams (customer lists, segmentation, one-time analysis), ...
Hello billie17, I took a look at both internal and external documentation and here is what I found. Short version: yes, binding the PROD catalog read-only to a non-prod workspace is a documented pattern. The binding docs list "read-only access to pro...
SummaryIn an AI/BI Dashboard with a semantic model, selecting a row in a table widget cross-filters a related table through the relationship. This works for normal values. When the selected row has a text value containing a carriage return followed b...
Hi @Akash_Murade,Thanks for the clean repro, it makes this really easy to follow. It looks like a bug in how the selected value gets turned into the filter literal, so I'd raise it with Databricks support as well so it gets tracked properly.Until it'...
I have a requirement to build a custom designed quality dashboard in dbx. The requirement is like user have to view the quality of data metrics in a single dahsboard for many tables, irrespective of viewing it via inbuilt data quality option availabl...
The per-table "Quality" view you're describing comes from data quality monitoring (anomaly detection). It already writes its results for every monitored table into one system table, system.data_quality_monitoring.table_results. Point an AI/BI dashboa...
Is it possible: a Databricks App embedding Power BI ? Rather than placing Genie inside Power BI, place Power BI inside Databricks. A Databricks App (React or Streamlit) hosts native Genie chat alongside a Power BI report embedded via the JavaScript S...
Yes, this works. The thing to plan for is that the two halves need two separate sign-ins. Genie runs on the Databricks user token that the app forwards (on-behalf-of user authorization). Power BI needs its own Entra ID token for the Power BI API, and...
When a sales query runs slowly, inspect how many rows each join produces before changing compute size.Consider a hypothetical retailer joining order lines to payments using order_id. One customer’s order has three product lines and two payment recor...
Hello,I've created an AI/BI dashboard containing a geographical map visualisation showing US emissions data.When viewing the dashboard interactively, I'm able to zoom into the continental United States, allowing the geographical distribution of emiss...
Hi @bluffset7340, Thanks for the clear write-up and the screenshots.Your expectation makes sense, but this is how the PDF export currently works. The export renders the published dashboard from scratch, so the map opens in its default view. Zooming o...
I'm trying to manage a scheduled AI/BI dashboard email entirely through Terraform and the API. The goal is to send a monthly PDF snapshot of the dashboard, with specific filter values already applied, to a list of subscribers and specified attachment...
@yanchr I validated this using Lakeflow Jobs Dashboard tasks, the Jobs REST API and the Databricks Terraform provider. Here are the options I have tried and the findings:1: Lakeflow Jobs Dashboard task (simplest approach)Option A : Configure through ...
"We want more Genie Agents and dashboards. We just don't want to end up with 400 of them." The business wants more self-service. The platform team is worried about two things: sprawl (nobody can find the right one, and three versions of "revenue" app...
Issue: Pipeline failed with INGESTION_GATEWAY_SQL_SERVER_AGENT_NOT_RUNNING, but the SQL Server Agent on Azure SQL Managed Instance is always running and cannot be stopped. All CDC prerequisites are confirmed valid:sys.databases: is_cdc_enabled = 1 fo...
Hi @vsrekha213 , did running the checks as the connector login show a permission gap?If upgrading the utility script to 1.7 and re-running lakeflowFixPermissions cleared the error, please click Accept as Solution so others hitting this false positiv...
When trying to download the public domain seismic data of Equinor’s Volve field (https://www.equinor.com/energy/volve-data-sharing) using a browser (Edge or Chrome) this fails after 2 hours due to network errors. Resuming only provides once off relie...
The browser is the bottleneck, not your line: it pulls a 2 TB file over a single HTTP connection, so you get ~8 Mbps and any blip kills the transfer. The Volve data sits in Azure Blob Storage, so download it with AzCopy instead. AzCopy splits the fil...
Clients ask me the same three questions all the time: What are system tables? What are they about? And what can I actually do with them? I recently came across a Databricks blog that answers the last one brilliantly: Top 5 System Table Queries for U...
@DoTA , love your comments. All very valid points. Just adding a couple of things: 1. On the join, I'd write the price window as usage_end_time >= price_start_time AND (price_end_time IS NULL OR usage_end_time < price_end_time) instead of BETWEEN. T...
Every IT function I've worked with eventually asks the same question, and can never answer it cleanly and clearly: "What did each team actually cost us last month?"When speaking with the platform team at a large UK bank, the realisation was that the ...
Good pattern. Two things I'd add for anyone copying this, since they're the parts that tend to surprise people afterwards.1. Tags are not retroactive. A usage row written without a team tag stays untagged forever. For history you can still attribute ...
I do not see the option as mentioned in the documentation here: https://docs.databricks.com/aws/en/dashboards/#:~:text=Download%20results%E2%80%8B,final%20file%20download.Please let me know if PNG is the only available option currently?
Hi @amdata ,It was possible until recently There's a bug and databricks team is working on a fix. So soon they should release a fix and then you will be able to export to csv as stated in documentation. Check below thread for more info:ONLY PNG form...
Hello dear community, i am trying to revoke permissions with the API for SQL-Warehouse. Granting permissions isn't a problem and works like a charme. But revoking won't function. I tried "NO_PERMISSIONS", "NO PERMISSIONS", "DENY", "REVOKE" But i al...
Have you tried checking whether the API supports removing permissions by sending an empty permission list or updating the warehouse’s access control settings? Granting and revoking don’t always use the same values, so the exact API endpoint and paylo...
Super excited about learning how AI can help improve performance and throughout for our database customers.
Interesting topic! Could you explain how indexless indexes work and how they can improve database query performance? I’d be interested to learn about their practical use cases and any limitations compared with traditional indexing.
