Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Hi all,I am using the official ODBC driver for databricks downloaded from here (the latest version) and trying to have a dotnet API (C#) fetching data from databricks via the driver. I am using the general Microsoft package for ODBC connection - Syst...
Instead of named parameters, the ODBC .NET Provider uses positional parameters that are marked with a question mark (?) in the syntax of the command text.Please make sure that UseNativeQuery to false(0) in the odbc connection string as they have ment...
I just want to run push down queries for example update or run procedures into azure sql server using shared cluster.We have built modules which were running without any issues using spark gateway to create a connection to azure sql and running updat...
Hi,Did you try like below ?# Define the JDBC connection propertiesjdbc_url = "jdbc:sqlserver://<your_server>.database.windows.net:1433;database=<your_database>"connection_properties = { "user": "<your_username>", "password": "<your_password>", ...
Hi All,I've been using notebooks to run patch requests to an external API using the Python requests library. Often times certain notebooks will randomly start to fail throughout the day and will raise a ImportHookFinder.find_spec() error when attempt...
Hey, Did you manage to solve this issue? I am experiencing the same error but under a different context of using pytest in a notebook.My scenario:import pytest import os import sys os.chdir(f'/Workspace/Shared/DataTechnology-Databricks-Core') # Skip...
I am not able to access the databases for practice
Which databases do you refer to?
I have created a legacy dashboard in Databricks and I'm trying to grant "Can Manage" access to my colleague. However, when I use Run as Owner credentials I am only able to provide "Can View" access. If I switch to Run as Viewer credentials, I can ass...
Got the solution.
Team,I did setup a SQL Warehouse Cluster to support request from Mobile devices through REST API. I read through the documentation of concurrent query limit which is 10. But in my scenario I had 5 small clusters and the query monitoring indicated the...
We have a similar problem: our self service BI tool Looker is using SQL warehouse and queries that usually run in a few seconds randomly fail with this message (logged in Looker history explore) "Java::JavaSql::SQLException: [Databricks][JDBCDriver](...
Hi,I'm trying to individually parameterize visualization widgets by following this tutorial https://docs.databricks.com/en/dashboards/parameters.html#static-widget-parametersHowever, it seems the Parameter section is missing. Does anyone facing the s...
I have found a solution. I have to toggle the show filters button, then the Parameter section will show up.
In this post, we'll examine one approach to creating a sparkline in a Databricks Dashboard table. Approach As of writing this post, there is no built-in method of creating sparklines in a table, so we need to explore some workarounds. All workarounds...
Is there any official word as to when we can expect Chloropleth or Marker Map visuals in AI/BI Dashboards? I realize Legacy Dashboards are still supported, but it feels uncertain to build new ones with AI/BI Dashboards in GA.
Great question! The team is actively working on supporting Maps in AI/BI Dashboards. You can expect Marker Map to be available in a few weeks and Choropleth to come early next year.
Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know th...
Greetings,I'm writing this message because I want to understand how does the "automatic refresh" feature work for AI/BI dashboards that use SQL Serverless endpoints?I'm asking because sometimes the published dashboard refreshes when viewing the link ...
The dashboard will refresh under conditions such as Manual refresh, scheduled refresh or if a parameter in the refresh changes it will hit the refresh option
Resultset returned by DatabaseMetadata.getColumns does not include the variant column in a table. Only includes the non-variant column.Databricks JDBC driver 02.06.40.1071create table tvariant(rnum int, c1 variant);
Hi @151640 ,According to the documentation VARIANT data type in not supported by Databricks JDBC driver.Here is the list of supported data types:
Good morning, is there any parameter or configuration that causes all my data to be consulted without case distinction? insensitive?
Hi @raphaelblg ,do you know any update to this or any workaround?Regards,Mariano
Hi,Is it possible to convert existing delta table with partition having data to clustering? If so can you please suggest the steps required? I tried and searched but couldn't find any. Is it that liquid clustering can be done only for new Delta table...
Does Liquid Clustering accepts Merge or How Upsert can be done efficiently with Liquid clustered delta table
Hi,I have used "SET spark.sql.warehouse.dir" which creates the directory by default.Then I have created the database by command "CREATE DATABASE IF NOT EXISTS database_name;",but when I used "DESCRIBE DATABASE database_name" I could not find the loca...
Hi @Pavan3 ,If running DESCRIBE DATABASE the location is empty, then was created in the default CATALOG directory.What you can do is to create any table in that database and run DESCRIBE DETAIL on that table:Hope it helps
