Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
We have Azure Databricks - SQL Serverless Warehouse with Classic configuration. The config details shared in below snip. As per the Auto Stop config, the Serverless warehouse should be stopped after 10 min of inactivity. However, when we were monitor...
@Digvijay_11 A dbsql warehouse can be triggered not only by a query from a JDBC/ODBC client but also by an idle session, as sessions are managed within the backend clusters. Clusters must be running to maintain these sessions, even before a query is...
Hello,I'm designing a system that combines a lake-house and a real-time path that federates across multiple databases. The requirements led us to adopt Starburst Galaxy (a cloud-hosted distributed query engine) for query federation across the various...
Hello there!So any updates so far? Also interesting in this solution.
I added a filter with the :name_parameter to the dashboard and it works fine.But if I add a date range picker for the date axis it doesn't do any effect (standalone, without the other filter enabled, it is working). It seems to me that the date pick...
Thanks a lot. I guess this was a case of not seeing the forest for the trees. But still, maybe the could add a tooltip or so for this field.
Hi,As a formal requirement in my project I need to keep original, raw (mainly CSVs and XMLs) files on the lake. Later on they are being ingested into Delta format backed medallion stages, bronze, silver, gold etc.From the audit, operations and discov...
Many thanks for raising it @bobmclaren .@Retired_mod Do you have any updates on the above?
Hi all, I am currently stuck because runing DESCRIBE DETAL in my catalog's tables return an error like:[PARSE_SYNTAX_ERROR] Syntax error at or near 'hive_metastore'. SQLSTATE: 42601 (line 1, pos 21)Why is this not supported in the dasboards but the s...
Both DESCRIBE and DESCRIBE DETAIL are supported by databricks sqlBut DESCRIBE DETAIL is only supported for tables not for viewsError you are getting is due to the SQL statement you have used is not valid and hence cannot be executedPlease check your ...
I'm interested in using the API to list all dashboards, but the API shows legacy dashboards only. Are there any plans to fix this API call to show all dashboards?I'm using this API call: https://docs.databricks.com/api/workspace/dashboards/listAnd th...
I understand the API is valid for legacy dashboards, but I need to include all dashboards, legacy or not.,
Hello,Currently, AI/BI Dashboards do not support Maps. This is a very important visual for those of us with geocoded data. We're stuck using Legacy Dashboards for this. Any ETA? Is this on the roadmap somewhere?Thanks,Angel
The team is actively working on supporting Maps in AI/BI Dashboards. You can expect Marker Map to be available in a few weeks and Choropleth to come early next year.
Dear community,Im trying to setup a connection to get data from a catalog / underlying tables from that catalog and load it directly into MS Access 365 (latest version). Is it possible to do this? What would be the best practice? Thanks,Bram
Hey guys,See here for a solution to this issue. You can specify the catalog when you setup the odbc driver.ODBC data source to connect to a Databricks catalo... - Databricks Community - 96354
Getting the below error when reading the snowflake tables data .We are successfully able to connect the respective tables .cannot display the data and other transformations.SparkConnectGrpcException: (net.snowflake.client.jdbc.SnowflakeSQLException) ...
Hi @ms_221 ,The SparkConnectGrpcException you're encountering, specifically mentioning that the incoming request with a certain IP/Token is not allowed to access Snowflake, suggests an issue related to network policies or access control within Snowfl...
I am trying to declare variable in SQL statement and try to execute it via ODBC C# driver(System.Data.Odbc 8.0.0) but it fails with parse syntax error.When I try the same query on SQL editor, it runs. Query:DECLARE VARIABLE users_core__user_name_last...
Hello @_Sumit_Kate Not all databases support variable declaration in the same way. It is possible System.Data.Odbc does not support it, in Databricks we use Simba ODBC drivers. But I would say let's check the official document too - https://learn....
I have implemented data masking on my Databricks table, and it works well when I append new rows, as the masking and unmasking function as expected. However, when I overwrite the table, the unmasking does not seem to work correctly, and the data rema...
Hi @Akshay_Petkar,The issue with data masking not persisting correctly after an overwrite in Databricks likely stems from how the overwrite operation interacts with masked data and user-defined functions for masking/unmasking. In Databricks, overwrit...
Hi all,I am using the official ODBC driver for databricks downloaded from here (the latest version) and trying to have a dotnet API (C#) fetching data from databricks via the driver. I am using the general Microsoft package for ODBC connection - Syst...
Instead of named parameters, the ODBC .NET Provider uses positional parameters that are marked with a question mark (?) in the syntax of the command text.Please make sure that UseNativeQuery to false(0) in the odbc connection string as they have ment...
I just want to run push down queries for example update or run procedures into azure sql server using shared cluster.We have built modules which were running without any issues using spark gateway to create a connection to azure sql and running updat...
Hi,Did you try like below ?# Define the JDBC connection propertiesjdbc_url = "jdbc:sqlserver://<your_server>.database.windows.net:1433;database=<your_database>"connection_properties = { "user": "<your_username>", "password": "<your_password>", ...
I am not able to access the databases for practice
Which databases do you refer to?
I have created a legacy dashboard in Databricks and I'm trying to grant "Can Manage" access to my colleague. However, when I use Run as Owner credentials I am only able to provide "Can View" access. If I switch to Run as Viewer credentials, I can ass...
Got the solution.
