- 10862 Views
- 11 replies
- 10 kudos
Azure Synapse versus databricks SQL endpoint performance comparison
Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know there ...
- 10862 Views
- 11 replies
- 10 kudos
- 11857 Views
- 7 replies
- 3 kudos
Resolved! AWS Glue and Databricks
Hello, we're receiving an error when running glue jobs to try and connect to and read from a Databricks SQL endpoint. Hello, we're receiving an error when running glue jobs to try and connect to and read from a Databricks SQL endpoint. An error occ...
- 11857 Views
- 7 replies
- 3 kudos
- 3 kudos
Hello @Vidula Khanna​ @Debayan Mukherjee​ ,I wanted to give you an update that might be helpful for your future customers, we worked with @Pavan Kumar Chalamcharla​ and through lots of trial and error we figured out a combination that works for SQL e...
- 3 kudos
- 1596 Views
- 0 replies
- 2 kudos
Availability of SQL Warehouse to Data Science and Engineering persona ​Hi All,Now we can use SQL Warehouse in our notebook execution.It's in previ...
Availability of SQL Warehouse to Data Science and Engineering persona ​ Hi All, Now we can use SQL Warehouse in our notebook execution. It's in preview now and soon will be GA.
- 1596 Views
- 0 replies
- 2 kudos
- 3580 Views
- 2 replies
- 1 kudos
Resolved! How/where can I set credentials for DataBricks SQL to create a external table.
I've triend this code in Databricks SQL create table people_db.GLAccount USING PARQUET LOCATION "abfss://datamesh@dlseu2dtaedwetldtlak9.dfs.core.windows.net/PricingAnalysis/rdv_60_134.vGLAccount.parquet" But I'm getting a "Invalid configuration...
- 3580 Views
- 2 replies
- 1 kudos
- 1 kudos
you can define 'data access configuration' in the admin panel.go to SQL warehouse settings -> Data Access configurationhttps://learn.microsoft.com/en-us/azure/databricks/sql/admin/data-access-configuration
- 1 kudos
- 12641 Views
- 5 replies
- 2 kudos
How to query object ID in Databricks SQL warehouse using only SQL?
I can see on Databricks SQL warehouse Data tab that clusters, catalogs and schemas have a unique ID. User created tables, views and functions must have and unique ID too, but it is not exposed to the user as far as I can tell. I need to retrieve the ...
- 12641 Views
- 5 replies
- 2 kudos
- 7777 Views
- 10 replies
- 7 kudos
DataBricks SQL: ODBC url to connect to DataBricks SQL tables
Hello Everyone, We are trying to connect DataBricks SQL warehouse using ODBC url but we are not able to do it. We can see only JDBC url in connection details which works fine. Was anyone able to connect using ODBC url? Can someone please help?
- 7777 Views
- 10 replies
- 7 kudos
- 7 kudos
Hi,Can you please try to connect once after disabling VPN in your local system (if its enabled)?Thanks.
- 7 kudos
- 12838 Views
- 10 replies
- 4 kudos
Resolved! Databricks SQL restful API to query delta table
As of today, can we use any Databricks SQL Restful API to query Delta Tables stored in ADLS from any external UI?There is some information mentioned over this link https://docs.databricks.com/sql/api/index.html? but not sure how to use them!!Checked ...
- 12838 Views
- 10 replies
- 4 kudos
- 4 kudos
I just saw this today.. https://www.databricks.com/blog/2023/03/07/databricks-sql-statement-execution-api-announcing-public-preview.html
- 4 kudos
- 6469 Views
- 4 replies
- 6 kudos
SQL Query execution plan explain and optimize the performance for query run.
When we executing SQL query in databricks SQL warehouse editor what will be best practices to optimize the execution plan and get result faster
- 6469 Views
- 4 replies
- 6 kudos
- 6 kudos
Hi @vinay kumar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 6 kudos
- 5326 Views
- 3 replies
- 9 kudos
Resolved! Databricks SQL Endpoint start times
When I first login and start using Databricks SQL, the endpoints always take a while to start. Is there anything I can do to improve the cold start experience on the platform?
- 5326 Views
- 3 replies
- 9 kudos
- 4066 Views
- 6 replies
- 1 kudos
SQL endpoint vCPU on Azure
How do I change the vCPU type for SQL Endpoint on Azure Databricks? Currently it picks as default DSv4 CPUs which reaches its quota limit although I have unused quota in other vCPU types. I faced similar issue while using Delta live tables but I was ...
- 4066 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi @Tarique Anwar​ , I don't think changing the vCPU type, for now, is possible. However, I can check with the product team on this.https://docs.microsoft.com/en-us/azure/databricks//sql/admin/sql-endpoints#required-azure-vcpu-quota
- 1 kudos
- 4085 Views
- 3 replies
- 0 kudos
Resolved! Is it possible to break down the cost per endpoint in Databricks SQL?
Need some advice for managing my SQL environment and handling internal chargebacks to the teams using the endpoint.
- 4085 Views
- 3 replies
- 0 kudos
- 0 kudos
Thank you for sharing your valuable solution, it's work properly.LiveTheOrangeLife
- 0 kudos
- 11575 Views
- 5 replies
- 10 kudos
- 11575 Views
- 5 replies
- 10 kudos
- 10 kudos
Great question! There are similarities and differences:SimilaritiesPhoton is enabled on bothYou have Databricks Runtime on bothDifferencesDatabricks Runtime (DBR) version is managed and auto-upgraded in Databricks SQL. Because SQL is a narrower workl...
- 10 kudos
- 8813 Views
- 13 replies
- 14 kudos
SQL endpoint JDBC table support
Hi, is there any way/workaround to query JDBC tables the same way one can do with other type of clusters?Doing so right now causes an error saying that only text based files are supported (json, parquet, delta etc) even though the tables are recogniz...
- 8813 Views
- 13 replies
- 14 kudos
- 14 kudos
I've been waiting patiently for this option since public preview early 2021. The vast majority of our data is in SQL Server databases, and because we are unable to query these data sources is the primary reason the data team hasn't adopted SQL Worksp...
- 14 kudos
- 1918 Views
- 0 replies
- 0 kudos
What are the Best Practices for SQL Endpoint sizing?
I see that cluster sizes are mentioned here https://docs.databricks.com/sql/admin/sql-endpoints.html#cluster-size but I would like to know when to pick what type of cluster (data size/ users/ concurrency) without having to do too much trial and error...
- 1918 Views
- 0 replies
- 0 kudos
- 4693 Views
- 1 replies
- 0 kudos
Resolved! Can I implement Row Level Security for users when using SQL Endpoints?
I'd like to be able to limit the rows users see when querying tables in Databricks SQL based on what access level each user is supposed to be granted. Is this possible in the SQL environment?
- 4693 Views
- 1 replies
- 0 kudos
- 0 kudos
Using dynamic views you can specify permissions down to the row or field level e.g. CREATE VIEW sales_redacted AS SELECT user_id, country, product, total FROM sales_raw WHERE CASE WHEN is_member('managers') THEN TRUE ELSE total <= 1...
- 0 kudos