Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Dear community,Im trying to setup a connection to get data from a catalog / underlying tables from that catalog and load it directly into MS Access 365 (latest version). Is it possible to do this? What would be the best practice? Thanks,Bram
Hey guys,See here for a solution to this issue. You can specify the catalog when you setup the odbc driver.ODBC data source to connect to a Databricks catalo... - Databricks Community - 96354
Getting the below error when reading the snowflake tables data .We are successfully able to connect the respective tables .cannot display the data and other transformations.SparkConnectGrpcException: (net.snowflake.client.jdbc.SnowflakeSQLException) ...
Hi @ms_221 ,The SparkConnectGrpcException you're encountering, specifically mentioning that the incoming request with a certain IP/Token is not allowed to access Snowflake, suggests an issue related to network policies or access control within Snowfl...
I am trying to declare variable in SQL statement and try to execute it via ODBC C# driver(System.Data.Odbc 8.0.0) but it fails with parse syntax error.When I try the same query on SQL editor, it runs. Query:DECLARE VARIABLE users_core__user_name_last...
Hello @_Sumit_Kate Not all databases support variable declaration in the same way. It is possible System.Data.Odbc does not support it, in Databricks we use Simba ODBC drivers. But I would say let's check the official document too - https://learn....
I have implemented data masking on my Databricks table, and it works well when I append new rows, as the masking and unmasking function as expected. However, when I overwrite the table, the unmasking does not seem to work correctly, and the data rema...
Hi @Akshay_Petkar,The issue with data masking not persisting correctly after an overwrite in Databricks likely stems from how the overwrite operation interacts with masked data and user-defined functions for masking/unmasking. In Databricks, overwrit...
Hi all,I am using the official ODBC driver for databricks downloaded from here (the latest version) and trying to have a dotnet API (C#) fetching data from databricks via the driver. I am using the general Microsoft package for ODBC connection - Syst...
Instead of named parameters, the ODBC .NET Provider uses positional parameters that are marked with a question mark (?) in the syntax of the command text.Please make sure that UseNativeQuery to false(0) in the odbc connection string as they have ment...
I just want to run push down queries for example update or run procedures into azure sql server using shared cluster.We have built modules which were running without any issues using spark gateway to create a connection to azure sql and running updat...
Hi,Did you try like below ?# Define the JDBC connection propertiesjdbc_url = "jdbc:sqlserver://<your_server>.database.windows.net:1433;database=<your_database>"connection_properties = { "user": "<your_username>", "password": "<your_password>", ...
Hi All,I've been using notebooks to run patch requests to an external API using the Python requests library. Often times certain notebooks will randomly start to fail throughout the day and will raise a ImportHookFinder.find_spec() error when attempt...
Hey, Did you manage to solve this issue? I am experiencing the same error but under a different context of using pytest in a notebook.My scenario:import pytest import os import sys os.chdir(f'/Workspace/Shared/DataTechnology-Databricks-Core') # Skip...
I am not able to access the databases for practice
Which databases do you refer to?
I have created a legacy dashboard in Databricks and I'm trying to grant "Can Manage" access to my colleague. However, when I use Run as Owner credentials I am only able to provide "Can View" access. If I switch to Run as Viewer credentials, I can ass...
Got the solution.
Team,I did setup a SQL Warehouse Cluster to support request from Mobile devices through REST API. I read through the documentation of concurrent query limit which is 10. But in my scenario I had 5 small clusters and the query monitoring indicated the...
We have a similar problem: our self service BI tool Looker is using SQL warehouse and queries that usually run in a few seconds randomly fail with this message (logged in Looker history explore) "Java::JavaSql::SQLException: [Databricks][JDBCDriver](...
Hi,I'm trying to individually parameterize visualization widgets by following this tutorial https://docs.databricks.com/en/dashboards/parameters.html#static-widget-parametersHowever, it seems the Parameter section is missing. Does anyone facing the s...
I have found a solution. I have to toggle the show filters button, then the Parameter section will show up.
In this post, we'll examine one approach to creating a sparkline in a Databricks Dashboard table. Approach As of writing this post, there is no built-in method of creating sparklines in a table, so we need to explore some workarounds. All workarounds...
Is there any official word as to when we can expect Chloropleth or Marker Map visuals in AI/BI Dashboards? I realize Legacy Dashboards are still supported, but it feels uncertain to build new ones with AI/BI Dashboards in GA.
Great question! The team is actively working on supporting Maps in AI/BI Dashboards. You can expect Marker Map to be available in a few weeks and Choropleth to come early next year.
Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know th...
Greetings,I'm writing this message because I want to understand how does the "automatic refresh" feature work for AI/BI dashboards that use SQL Serverless endpoints?I'm asking because sometimes the published dashboard refreshes when viewing the link ...
The dashboard will refresh under conditions such as Manual refresh, scheduled refresh or if a parameter in the refresh changes it will hit the refresh option
