Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights. Keynote: Data Warehouse presente...
I've created an external table that points to an XML file on the ADLS. I've installed spark-xml library on my cluster. I can query the table on the cluster.However, I cannot query the table on Databricks SQL. I get the following error. I suppose th...
Hello @Bilal Haniff​ - My name is Piper and I'm a moderator for the community. It's nice to meet you! Let's see how your fellow community members answer first and then the team will follow up if they need to.
Thanks to @Artem Yevtushenko​ . That's an awesome post.
In recent blog post posts (here and here) Databricks promotes a way of making BI queries to Databricks faster. It requires a runtime of 8.3 or higher, but what is required on the PowerBI side of things if one uses the databricks connector? Does that ...
Hi @sondrewb​ The latest version of PowerBI is shipped with Databricks Connector running 2.6.17 ODBC Driver and therefore can be used to utilize Cloud Fetch
Run :-yarn cache clean
Test Question 1
My name is Barbara Potts , and I enjoy Astro reading and finding ways to help them have an working experience. Vrischik Rashifal Personality Traits
I see that cluster sizes are mentioned here https://docs.databricks.com/sql/admin/sql-endpoints.html#cluster-size but I would like to know when to pick what type of cluster (data size/ users/ concurrency) without having to do too much trial and error...
Hi @ MoJaMa ! My name is Kaniz, and I'm the technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers on the Forum have an answer to your question first. Or else I will follow up shortly with a response.
k3
I would like to know why and when I will do a Z-Ordering on my Delta table?
Apache Spark does not have the features of a relational database wherein you can do a search on a primary key for example. It is forced to read in 100% of the data (generally speaking), which hurts performance at Gigabyte+ scales and test every singl...
If the external dataset is registered in the Hive metastore then yes.
Yes. You can use the Databricks SQL REST API to do so. https://docs.databricks.com/sql/api/query-history.html
After testing this. I was unable to create a global temporary view on a SQL Endpoint. I was able to create a temporary view for that session as well as a normal view. So while the global temp view seems to be unsupported there are a number of other o...
Unfortunately, no. There is not a way to change the default database in DBSQL.
