Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
Is there any official word as to when we can expect Chloropleth or Marker Map visuals in AI/BI Dashboards? I realize Legacy Dashboards are still supported, but it feels uncertain to build new ones with AI/BI Dashboards in GA.
Great question! The team is actively working on supporting Maps in AI/BI Dashboards. You can expect Marker Map to be available in a few weeks and Choropleth to come early next year.
Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know th...
Hello,Right now I have chosen the free tier mode and region is east US. But I am unable to create a all purpose compute cluster. Any config I chose it says not supported. Any help is appreciated for pointing which config for worker and driver I shoul...
Greetings,I'm writing this message because I want to understand how does the "automatic refresh" feature work for AI/BI dashboards that use SQL Serverless endpoints?I'm asking because sometimes the published dashboard refreshes when viewing the link ...
The dashboard will refresh under conditions such as Manual refresh, scheduled refresh or if a parameter in the refresh changes it will hit the refresh option
Dear community,Im trying to setup a connection to get data from a catalog / underlying tables from that catalog and load it directly into MS Access 365 (latest version). Is it possible to do this? What would be the best practice? Thanks,Bram
Thanks so much. It just does not work for me. I can't find a place in Access where I can paste in the connection string. I found a workaround by connecting to the table in the unit catalog via Excel and then linking the Excel table in Access. Ugly bu...
Hello,Currently, AI/BI Dashboards do not support Maps. This is a very important visual for those of us with geocoded data. We're stuck using Legacy Dashboards for this. Any ETA? Is this on the roadmap somewhere?Thanks,Angel
Resultset returned by DatabaseMetadata.getColumns does not include the variant column in a table. Only includes the non-variant column.Databricks JDBC driver 02.06.40.1071create table tvariant(rnum int, c1 variant);
Hi @151640 ,According to the documentation VARIANT data type in not supported by Databricks JDBC driver.Here is the list of supported data types:
Good morning, is there any parameter or configuration that causes all my data to be consulted without case distinction? insensitive?
Hi @raphaelblg ,do you know any update to this or any workaround?Regards,Mariano
Hi,Is it possible to convert existing delta table with partition having data to clustering? If so can you please suggest the steps required? I tried and searched but couldn't find any. Is it that liquid clustering can be done only for new Delta table...
Does Liquid Clustering accepts Merge or How Upsert can be done efficiently with Liquid clustered delta table
Hi,I have used "SET spark.sql.warehouse.dir" which creates the directory by default.Then I have created the database by command "CREATE DATABASE IF NOT EXISTS database_name;",but when I used "DESCRIBE DATABASE database_name" I could not find the loca...
Hi @Pavan3 ,If running DESCRIBE DATABASE the location is empty, then was created in the default CATALOG directory.What you can do is to create any table in that database and run DESCRIBE DETAIL on that table:Hope it helps
Hi! I'm developing a .NET app and i want to use the databricks warehouse as database. I have gold delta tables that i want to query. In the documentation, i can see a ODBC/JDBC driver, are those connector fast? there are another way to connect? what ...
We have been using .Net apps connected to Databricks delta tables through Clusters, we have been using ODBC to achieve this. However we recently hit a roadblock after UC migration, where the UC all purpose cluster started giving issues with queries ...
Hi everyone,I'm curious about Databricks' approach to encrypting and decrypting Parquet files. Does Databricks adhere to standard encryption/decryption methods for Parquet? If not, what specific methods or techniques are used?I'd appreciate any insig...
Since Databricks uses Spark, you should be able to use e.g. Columnar EncryptionBesides, you can look into this and aes-specific functions.
I would like to create a simple governance dashboard with multiple queries (a query to see user login events, a query to see sql statements ran, a query for jobs executed, etc.)What i would like to do is have a single user name parameter which would ...
Yes you can set dashboard parameters so you provide the username on the parameter or widget and it gets distributed to the different queries https://docs.databricks.com/en/dashboards/parameters.html
I am preparing to migrate from EMR to Databricks and would like to know the best practices for this process. Is there a direct connector, such as a JDBC connector, available to facilitate the migration? Alternatively, would it be more effective to ex...
Please review this doc. https://www.databricks.com/resources/guide/emr-databricks-migration-guide
I have huge datasets, transformation, display, print, show are working well on this data when read in a pandas dataframe. But the same dataframe when converted to a spark dataframe, is taking minutes to display even a single row and hours to write th...
I understand you want it sooner. Did it at least write the data in 10 minutes compared to not writing before? There are more knobs you can tweak like spark.sql.shuffle.partitions=auto Do you have any index columns in your spatial data that can be us...
