Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Getting the below error when reading the snowflake tables data .We are successfully able to connect the respective tables .cannot display the data and other transformations.SparkConnectGrpcException: (net.snowflake.client.jdbc.SnowflakeSQLException) ...
Hi @ms_221 ,The SparkConnectGrpcException you're encountering, specifically mentioning that the incoming request with a certain IP/Token is not allowed to access Snowflake, suggests an issue related to network policies or access control within Snowfl...
I am trying to declare variable in SQL statement and try to execute it via ODBC C# driver(System.Data.Odbc 8.0.0) but it fails with parse syntax error.When I try the same query on SQL editor, it runs. Query:DECLARE VARIABLE users_core__user_name_last...
Hello @_Sumit_Kate Not all databases support variable declaration in the same way. It is possible System.Data.Odbc does not support it, in Databricks we use Simba ODBC drivers. But I would say let's check the official document too - https://learn....
I have implemented data masking on my Databricks table, and it works well when I append new rows, as the masking and unmasking function as expected. However, when I overwrite the table, the unmasking does not seem to work correctly, and the data rema...
Hi @Akshay_Petkar,The issue with data masking not persisting correctly after an overwrite in Databricks likely stems from how the overwrite operation interacts with masked data and user-defined functions for masking/unmasking. In Databricks, overwrit...
Hi all,I am using the official ODBC driver for databricks downloaded from here (the latest version) and trying to have a dotnet API (C#) fetching data from databricks via the driver. I am using the general Microsoft package for ODBC connection - Syst...
Instead of named parameters, the ODBC .NET Provider uses positional parameters that are marked with a question mark (?) in the syntax of the command text.Please make sure that UseNativeQuery to false(0) in the odbc connection string as they have ment...
I just want to run push down queries for example update or run procedures into azure sql server using shared cluster.We have built modules which were running without any issues using spark gateway to create a connection to azure sql and running updat...
Hi,Did you try like below ?# Define the JDBC connection propertiesjdbc_url = "jdbc:sqlserver://<your_server>.database.windows.net:1433;database=<your_database>"connection_properties = { "user": "<your_username>", "password": "<your_password>", ...
I am not able to access the databases for practice
Which databases do you refer to?
I have created a legacy dashboard in Databricks and I'm trying to grant "Can Manage" access to my colleague. However, when I use Run as Owner credentials I am only able to provide "Can View" access. If I switch to Run as Viewer credentials, I can ass...
Got the solution.
Team,I did setup a SQL Warehouse Cluster to support request from Mobile devices through REST API. I read through the documentation of concurrent query limit which is 10. But in my scenario I had 5 small clusters and the query monitoring indicated the...
We have a similar problem: our self service BI tool Looker is using SQL warehouse and queries that usually run in a few seconds randomly fail with this message (logged in Looker history explore) "Java::JavaSql::SQLException: [Databricks][JDBCDriver](...
Hi,I'm trying to individually parameterize visualization widgets by following this tutorial https://docs.databricks.com/en/dashboards/parameters.html#static-widget-parametersHowever, it seems the Parameter section is missing. Does anyone facing the s...
I have found a solution. I have to toggle the show filters button, then the Parameter section will show up.
In this post, we'll examine one approach to creating a sparkline in a Databricks Dashboard table. Approach As of writing this post, there is no built-in method of creating sparklines in a table, so we need to explore some workarounds. All workarounds...
Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know there ...
Greetings,I'm writing this message because I want to understand how does the "automatic refresh" feature work for AI/BI dashboards that use SQL Serverless endpoints?I'm asking because sometimes the published dashboard refreshes when viewing the link ...
The dashboard will refresh under conditions such as Manual refresh, scheduled refresh or if a parameter in the refresh changes it will hit the refresh option
Resultset returned by DatabaseMetadata.getColumns does not include the variant column in a table. Only includes the non-variant column.Databricks JDBC driver 02.06.40.1071create table tvariant(rnum int, c1 variant);
Hi @151640 ,According to the documentation VARIANT data type in not supported by Databricks JDBC driver.Here is the list of supported data types:
Good morning, is there any parameter or configuration that causes all my data to be consulted without case distinction? insensitive?
Hi @raphaelblg ,do you know any update to this or any workaround?Regards,Mariano
Hi,Is it possible to convert existing delta table with partition having data to clustering? If so can you please suggest the steps required? I tried and searched but couldn't find any. Is it that liquid clustering can be done only for new Delta table...
Does Liquid Clustering accepts Merge or How Upsert can be done efficiently with Liquid clustered delta table
