Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Hello,I'm designing a system that combines a lake-house and a real-time path that federates across multiple databases. The requirements led us to adopt Starburst Galaxy (a cloud-hosted distributed query engine) for query federation across the various...
Hello there!So any updates so far? Also interesting in this solution.
I added a filter with the :name_parameter to the dashboard and it works fine.But if I add a date range picker for the date axis it doesn't do any effect (standalone, without the other filter enabled, it is working). It seems to me that the date pick...
Thanks a lot. I guess this was a case of not seeing the forest for the trees. But still, maybe the could add a tooltip or so for this field.
Hi,As a formal requirement in my project I need to keep original, raw (mainly CSVs and XMLs) files on the lake. Later on they are being ingested into Delta format backed medallion stages, bronze, silver, gold etc.From the audit, operations and discov...
Many thanks for raising it @bobmclaren .@Retired_mod Do you have any updates on the above?
We work with a application that connects to our Databricks serverless SQL warehouse via Databricks JDBC driver. It runs a few thousand SQL select statements everyday, and a small percentage of them will fail with the following error details: java.sql...
We are trying to schedule updates to streaming tables and materialized views in Azure Databricks that we have defined in dbt.Two options we are considering are `SCHEDULE CRON` and just scheduling `dbt run` commands via CI/CD. The `SCHEDULE CRON` opti...
Hi all, I am currently stuck because runing DESCRIBE DETAL in my catalog's tables return an error like:[PARSE_SYNTAX_ERROR] Syntax error at or near 'hive_metastore'. SQLSTATE: 42601 (line 1, pos 21)Why is this not supported in the dasboards but the s...
Both DESCRIBE and DESCRIBE DETAIL are supported by databricks sqlBut DESCRIBE DETAIL is only supported for tables not for viewsError you are getting is due to the SQL statement you have used is not valid and hence cannot be executedPlease check your ...
I'm interested in using the API to list all dashboards, but the API shows legacy dashboards only. Are there any plans to fix this API call to show all dashboards?I'm using this API call: https://docs.databricks.com/api/workspace/dashboards/listAnd th...
I understand the API is valid for legacy dashboards, but I need to include all dashboards, legacy or not.,
Hello,Currently, AI/BI Dashboards do not support Maps. This is a very important visual for those of us with geocoded data. We're stuck using Legacy Dashboards for this. Any ETA? Is this on the roadmap somewhere?Thanks,Angel
The team is actively working on supporting Maps in AI/BI Dashboards. You can expect Marker Map to be available in a few weeks and Choropleth to come early next year.
Dear community,Im trying to setup a connection to get data from a catalog / underlying tables from that catalog and load it directly into MS Access 365 (latest version). Is it possible to do this? What would be the best practice? Thanks,Bram
Hey guys,See here for a solution to this issue. You can specify the catalog when you setup the odbc driver.ODBC data source to connect to a Databricks catalo... - Databricks Community - 96354
Getting the below error when reading the snowflake tables data .We are successfully able to connect the respective tables .cannot display the data and other transformations.SparkConnectGrpcException: (net.snowflake.client.jdbc.SnowflakeSQLException) ...
Hi @ms_221 ,The SparkConnectGrpcException you're encountering, specifically mentioning that the incoming request with a certain IP/Token is not allowed to access Snowflake, suggests an issue related to network policies or access control within Snowfl...
I am trying to declare variable in SQL statement and try to execute it via ODBC C# driver(System.Data.Odbc 8.0.0) but it fails with parse syntax error.When I try the same query on SQL editor, it runs. Query:DECLARE VARIABLE users_core__user_name_last...
Hello @_Sumit_Kate Not all databases support variable declaration in the same way. It is possible System.Data.Odbc does not support it, in Databricks we use Simba ODBC drivers. But I would say let's check the official document too - https://learn....
I have implemented data masking on my Databricks table, and it works well when I append new rows, as the masking and unmasking function as expected. However, when I overwrite the table, the unmasking does not seem to work correctly, and the data rema...
Hi @Akshay_Petkar,The issue with data masking not persisting correctly after an overwrite in Databricks likely stems from how the overwrite operation interacts with masked data and user-defined functions for masking/unmasking. In Databricks, overwrit...
Hi all,I am using the official ODBC driver for databricks downloaded from here (the latest version) and trying to have a dotnet API (C#) fetching data from databricks via the driver. I am using the general Microsoft package for ODBC connection - Syst...
Instead of named parameters, the ODBC .NET Provider uses positional parameters that are marked with a question mark (?) in the syntax of the command text.Please make sure that UseNativeQuery to false(0) in the odbc connection string as they have ment...
I just want to run push down queries for example update or run procedures into azure sql server using shared cluster.We have built modules which were running without any issues using spark gateway to create a connection to azure sql and running updat...
Hi,Did you try like below ?# Define the JDBC connection propertiesjdbc_url = "jdbc:sqlserver://<your_server>.database.windows.net:1433;database=<your_database>"connection_properties = { "user": "<your_username>", "password": "<your_password>", ...
Hi All,I've been using notebooks to run patch requests to an external API using the Python requests library. Often times certain notebooks will randomly start to fail throughout the day and will raise a ImportHookFinder.find_spec() error when attempt...
Hey, Did you manage to solve this issue? I am experiencing the same error but under a different context of using pytest in a notebook.My scenario:import pytest import os import sys os.chdir(f'/Workspace/Shared/DataTechnology-Databricks-Core') # Skip...
