- 3619 Views
- 4 replies
- 1 kudos
Error in SQL Warehouse: User is not part of org
I tried to start the Databricks SQL Warehouse cluster today, but received the following error message:Clusters are failing to launch. Cluster launch will be retired Request to create a cluster failed with an exception: PERMISSION_DENIED: User xxxx is...
- 3619 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi All,What you need to do is set a new owner. You can do this by clicking on permissions, then the setup icon, and choosing Assign new owner.It works for me.Thanks
- 1 kudos
- 9756 Views
- 7 replies
- 0 kudos
using databricks sql warehouse as web app backend
Hi,I wanted to ask if anyone is using Databricks SQL Warehouse as backend for small to large scale web application? What are your thoughts about it, specially what Databricks team thinks of it ?Kind Regards,A
- 9756 Views
- 7 replies
- 0 kudos
- 0 kudos
I’ve experimented with using Databricks SQL Warehouse as the backend for a web app, and it has its advantages, but like any tool, it depends on your specific requirements.From my experience, it’s great for handling large datasets and performing heavy...
- 0 kudos
- 10948 Views
- 6 replies
- 3 kudos
Resolved! SQL Warehouse Serverless - Not able to access the external tables in the hive_metastore
I have DLT tables created under the hive_metastore with external data stored in ADL gen2.The ADL blob storage is mounted into /mnt/<storage-account>The tables are successfully created and accessible from my notebooks, as well the ADL storage.I have c...
- 10948 Views
- 6 replies
- 3 kudos
- 12190 Views
- 5 replies
- 0 kudos
Databricks SQL Warehouse did not auto stop after specified 90 minute interval - why not?
In this specific case, we're running a 2XSmall SQL Warehouse on Databricks SQL.In looking at the SQL Warehouse monitoring log for this cluster, we noticed:final query executed by user at 10:26 on 2023-06-20no activity for some time, yet cluster remai...
- 12190 Views
- 5 replies
- 0 kudos
- 0 kudos
Also dealing with the same issue! Anybody has any idea how to check it? There is no sort of logs and no actual query happens
- 0 kudos
- 24940 Views
- 7 replies
- 1 kudos
Resolved! How to use Service Principal to connect PowerBI to Databrick SQL Warehouse
Hi allI'm struggling to connect PowerBI service to a Databricks SQL Warehouse using a service principal. I'm following mostly this guide.I created a new app registration in the AAD and created a client secret for it.Now I'm particularly struggling wi...
- 24940 Views
- 7 replies
- 1 kudos
- 1 kudos
In the end, once the Service Principal is properly authorized on the Databricks side, I had to create a Personal Access Token for the Service Principal using the Databricks API. On the Power BI service side I then had to use username = 'token' and as...
- 1 kudos
- 1465 Views
- 1 replies
- 1 kudos
Does JDBC and ODBC connection to Databricks Cluster or SQL Warehouse encrypted?
Hello, our consumers (Dell Boomi and other apps) needs data from Databricks. Databricks provides JDBC and ODBC drivers. Does JDBC and ODBC connection to Databricks Cluster or SQL Warehouse encrypted? I am talking about the data in-transit between Dat...
- 1465 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Rajesh Paul Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 1 kudos
- 3068 Views
- 1 replies
- 1 kudos
How to set timezone for SQL Warehouse?
Hi, I want to change the default time zone for SQL Warehoue in the SQL Persona. When I try to Edit the SQL warehouse settings in the "SQL Warehouses" section, I am not able to find any setting where I can set the time zone. I am aware that I can set ...
- 3068 Views
- 1 replies
- 1 kudos
- 1 kudos
Thanks. I am aware of the SET TIME ZONE command but I need to run this command every time I start the SQL warehouse. I am looking for a way to change the default time zone of the SQL warehouse. Something like "spark.sql.session.timeZone GMT+10" that ...
- 1 kudos
- 8588 Views
- 3 replies
- 3 kudos
Resolved! Cluster SQL Warehouse fails to Start.
I'm a new user of Databricks and I'm taking the Academy course, but I'm having difficulty starting a SQL Warehouse cluster. I've tried several different configurations, but I always get the same error:Clusters are failing to launch. Cluster launch wi...
- 8588 Views
- 3 replies
- 3 kudos
- 3 kudos
Hi @Luiz Ribeiro Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 3 kudos
- 18899 Views
- 2 replies
- 2 kudos
Resolved! Disabling query caching for SQL Warehouse
Hello everybody,I am currently trying to run some performance tests on queries in Databricks on Azure. For my tests, I am using a Classic SQL Warehouse in the SQL Editor. I have created two views that contain the same data but have different structur...
- 18899 Views
- 2 replies
- 2 kudos
- 2 kudos
They are probably executing the same query plan now that you say it. And yes, restarting the warehouse does theoretically works but it isnt a nice solution.I guess I will do some restarting and build averages to have a good comparison for now
- 2 kudos
- 3340 Views
- 2 replies
- 1 kudos
Integration Dolly with Databricks
Hi Databricks Team,Could you please share any links /docs/Sample notebooks to integrate Dolly with Databricks, our aim is to generate SQL queries based on the free text and execute it via databricks cluster/SQL warehouse.
- 3340 Views
- 2 replies
- 1 kudos
- 1 kudos
https://www.dbdemos.ai/demo.html?demoName=llm-dolly-chatbot is a good demonstration of Dolly (or really any LLM) for question answering. LLMs like this are not for SQL generation, but other LLMs are, like starcoderbase
- 1 kudos
- 4736 Views
- 2 replies
- 0 kudos
How disable disk cache in SQL Warehouse (Azure Databricks)?
Hi! I want to disable disk cache for SQL Warehouse in Azure Databricks, but it seems that is not possible. Is it correct?You can't use this configuration for SQL Warehouse (https://learn.microsoft.com/en-US/azure/databricks/optimizations/disk-cache#-...
- 4736 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @jlgr jlgr Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
- 0 kudos
- 9897 Views
- 3 replies
- 0 kudos
Omitting columns in an INSERT statement does not seem to work despite meeting the requirements
We want to use the INSERT INTO command with specific columns as specified in the official documentation. The only requirements for this are️ Databricks SQL warehouse version 2022.35 or higher️ Databricks Runtime 11.2 and aboveand the behaviour shou...
- 9897 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Fusselmanwog Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 0 kudos
- 3978 Views
- 2 replies
- 0 kudos
Can't access delta tables under SQL Warehouse cluster. Getting Error while using path .../_delta_log/000000000.checkpoint
In our Databricks workspace, we have several delta tables available in the hive_metastore catalog. we are able to access and query the data via Data Science & Engineering persona clusters with no issues. The cluster have the credential passthrough en...
- 3978 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Rafael Gomez Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so ...
- 0 kudos
- 6923 Views
- 2 replies
- 1 kudos
Spark Settings in SQL Warehouse
I'm running a query, trying to parse a string into a map, and I get the following error;org.apache.spark.SparkRuntimeException: Duplicate map key was found, please check the input data. If you want to remove the duplicated keys, you can set "spark.s...
- 6923 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Nicholas Mead Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedbac...
- 1 kudos
- 1573 Views
- 2 replies
- 2 kudos
Can I use a cluster created in Data Science & Engineering persona to run SQL commands in the SQL persona?
Hi,I have created a single-node cluster in Data Science & Engineering persona (Standard_DS3_v2). I don't have enough vCPU to create a SQL warehouse. Is there any way I can use the cluster to run a query in SQL persona?
- 1573 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi MadoYes, you can use cluster and run sql query in the notebook, please refer the following page for more details. https://docs.databricks.com/getting-started/quick-start.html#tutorial-query-data-with-notebookshttps://docs.databricks.com/getting-st...
- 2 kudos