Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Hi Databricks community,I’ve created a catalog called azure_data_factory and a database called studytube_azure_mysql_production. Within that database, I have three tables: academies, academy_naming_settings, and users.See the left side of the screens...
Hi @szymon_dybczak and @Raman_Unifeye ,Thanks for answering my questions. I have granted the same permissions for both catalogues:USE CATALOGUSE SCHEMA on the schemas under both cataloguesSELECT on the tables under both schemas and cataloguesI even ...
I was wondering if anyone has been able to display totals in a Table/Pivot visualization? Similar to what is possible in other BI tools?If I have a table with a bunch of rows and one of the columns is Total Cost, I want to be able to show a Total at ...
Totals are possible in pivot tables now, for both row and column groups. The option "Display total" is a bit hidden in the group properties.
Dear colleagues,I'm in need of finishing a dashboard with the new databricks dashboard structure, released somewhat recently. On it, I'll have some calculations which need to be percentages over certain partitions, such as `input_amount_percentage_pe...
It is possible to create dynamic parameter lists in Databricks dashboards—so, yes, the documentation is correct, but the crucial detail is that not all data sources or query environments support this feature in the exact same way, and certain limitat...
Hi Databricks community,I'm new to Databricks and I'm trying to connect Databricks to Azure MySQL using Azure Data Factory.When I run the pipeline, I get the following error: ErrorCode=AzureDatabricksCommandError, Hit an error when running the comma...
Could you provide more details about high level flow or design you are planning? Not understanding completely but you can take a look here how to connect ADF with Databricks via PATs -> https://www.sqlshack.com/integrating-azure-databricks-with-azure...
Hi guys,I am trying to use table_changes CDF function in an external SQL function run it from an SQL Warehouse serverless cluster in order to retrieve a set of changes from a given table. Here is the documentation for this fuunction:https://docs.data...
In the end, as a workaround I had to move/delegate the query to the .NET API backend. From API I can build the query in the exact way I need by previously processing filters, timestamps or versions, ending up with a similar code to the one displayed ...
For one of my client, we are building the entire semantic layer for Data (BI) reporting who uses Snowflake. Is there a way to quickly integrate AI/BI Genie on top of Snowflake ?
Hey @TJ-Leap-Forward , Yes — you can stand up Databricks AI/BI Genie on top of Snowflake quickly by federating Snowflake into Unity Catalog and then building Genie spaces over those governed datasets, without migrating data out of Snowflake. This wo...
Request: please adjust Databricks AI/BI Dashboard Filter Date Picker built-in style (font size, layout, etc.) so that the full datetime selected for "from" and "to" times are displayed (including all minutes and seconds digits) Why: it is frustrating...
Hi @SFDataEng ,Yes, that's super frustrating. I've just send feedback to databricks with a request of improvement of this feature. Tonight I'll also submit request on databricks ideas portal.
Hi folks, I am creating a SQL dashboard and want to know if I can re-use datasets within the same dashboard. The screenshot below captures what I would like to do pretty well, but to summarize... I need to run an computationally expensive query and w...
AgreementYes, a feature to support nested datasets in Databricks AI/BI dashboards would seem convenient, e.g. as in both examples in the OP's screenshot.Specific needA use case that comes to mind would be to avoid the maintenance of parallel code acr...
Hi community,we have several databricks workspaces per different teams and in each workspace several use case covered.How can we trace the costs per individual use cost for SQL Warehosue / serverless in case we use one SQL warehouse per workspace to ...
You have two related questions on Databricks SQL Warehouse (serverless) cost attribution and resource sharing across workspaces. Here’s a clear answer based on current Databricks capabilities and industry practice. Tracing Costs per Use Case (SQL War...
I'm trying to deploy a minimal Streamlit app as a Databricks App on a fresh Free/Community workspace and I get:"Compute error - App creation failed unexpectedly. Please remediate by deleting the app."As alternatives, I also tried the API and the CLI ...
Good morning, everyone.The app is working again. I've already tested it and it's working.
Hi,I want to create a visualization where i want to show top 10 playerName with most sum of counter by dayDate. I reached till here. But i don't know how to limit top 10 playerName.Any help will be highly appreciated.
Finally what i did is:create a new data source with is query:WITH daily_totals AS (SELECTevent_date,playerName,SUM(counter) AS total_counterFROM your_tableGROUP BY event_date, playerName),ranked AS (SELECTevent_date,playerName,total_counter,ROW_NUMBE...
Hi, I've created a service principal and setup OAuth - I can successfully call REST APIs to see workspace details. But, when I try to list the genie spaces in a workspace, I get {} as the result. In the UI, I can see two genie spaces I've created. An...
Hi @hch_fiq ,You need setup proper permissions for your service account to see genie space. Look at below Genie space ACL table from documentation. When there's no ACL set you won't see anynting. So, your Service Principal needs at least CAN VIEW/CAN...
Hello all (and, if you are watching these posts, Databricks employees/representatives ),I hope you take this idea into account - I haven't been able to find a place where one can vote on features, but I believe that this idea would make very real im...
Hi @QueryingQuagga , We always appreciate feature requests! If you are working with an account team, you can always pass this information along to them, they have the ability to submit feature requests and vote on existing feature requests as well. I...
I am attempting to create a Vizro dashboard in a databricks notebook. I have validated that the code to generate dashboard works is accessible when running the notebook on my local machine. However, when attempting to compile the dashboard on a datab...
This issue is common when attempting to run interactive dashboards (such as Vizro or Plotly Dash) within Databricks notebooks; many users face the "This site can't be reached" message because the dashboard tries to launch a local web server on an add...
I'm relatively new to Databricks and Spark and have decided to create a Spark cluster with AWS under the free 14 day trial.The JSON to the cluster is as follows:{"data_security_mode": "DATA_SECURITY_MODE_DEDICATED","single_user_name": "me@gmail.com",...
Hi @neesam, while the command is hanging, check the driver logs from the cluster page to see if they provide any clues about what might be causing this issue.
