cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

prasadvaze
by Valued Contributor II
  • 9448 Views
  • 11 replies
  • 10 kudos

Azure Synapse versus databricks SQL endpoint performance comparison

Has anyone done this and share details? I have a sample sql which ran on large SQL endpoint in 8min and synapse 1000DWU setting in 1hr. On small SQL endpoint it took 34min. What's the equivalent SQL Endpoint compute for Synapse@1000DWU? I know th...

  • 9448 Views
  • 11 replies
  • 10 kudos
Latest Reply
arslanapk99
New Contributor II
  • 10 kudos

the cost vary 

  • 10 kudos
10 More Replies
dannylee
by New Contributor III
  • 10469 Views
  • 7 replies
  • 3 kudos

Resolved! AWS Glue and Databricks

Hello, we're receiving an error when running glue jobs to try and connect to and read from a Databricks SQL endpoint.Hello, we're receiving an error when running glue jobs to try and connect to and read from a Databricks SQL endpoint.   An error occu...

  • 10469 Views
  • 7 replies
  • 3 kudos
Latest Reply
dannylee
New Contributor III
  • 3 kudos

Hello @Vidula Khanna​ @Debayan Mukherjee​ ,I wanted to give you an update that might be helpful for your future customers, we worked with @Pavan Kumar Chalamcharla​ and through lots of trial and error we figured out a combination that works for SQL e...

  • 3 kudos
6 More Replies
Ajay-Pandey
by Esteemed Contributor III
  • 1416 Views
  • 0 replies
  • 2 kudos

Availability of SQL Warehouse to Data Science and Engineering persona ​Hi All,Now we can use SQL Warehouse in our notebook execution.It's in previ...

Availability of SQL Warehouse to Data Science and Engineering persona​Hi All,Now we can use SQL Warehouse in our notebook execution.It's in preview now and soon will be GA.

image.png
  • 1416 Views
  • 0 replies
  • 2 kudos
Harry_L
by New Contributor II
  • 2924 Views
  • 2 replies
  • 1 kudos

Resolved! How/where can I set credentials for DataBricks SQL to create a external table.

I've triend this code in Databricks SQLcreate table people_db.GLAccount USING PARQUET LOCATION "abfss://datamesh@dlseu2dtaedwetldtlak9.dfs.core.windows.net/PricingAnalysis/rdv_60_134.vGLAccount.parquet"But I'm getting a "Invalid configuration v...

  • 2924 Views
  • 2 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

you can define 'data access configuration' in the admin panel.go to SQL warehouse settings -> Data Access configurationhttps://learn.microsoft.com/en-us/azure/databricks/sql/admin/data-access-configuration

  • 1 kudos
1 More Replies
RichardSCarchit
by New Contributor III
  • 11389 Views
  • 5 replies
  • 2 kudos

How to query object ID in Databricks SQL warehouse using only SQL?

I can see on Databricks SQL warehouse Data tab that clusters, catalogs and schemas have a unique ID. User created tables, views and functions must have and unique ID too, but it is not exposed to the user as far as I can tell.I need to retrieve the...

  • 11389 Views
  • 5 replies
  • 2 kudos
Latest Reply
Priyag1
Honored Contributor II
  • 2 kudos

Refer documentation once

  • 2 kudos
4 More Replies
ManuShell
by New Contributor III
  • 6571 Views
  • 10 replies
  • 7 kudos

DataBricks SQL: ODBC url to connect to DataBricks SQL tables

Hello Everyone,We are trying to connect DataBricks SQL warehouse using ODBC url but we are not able to do it. We can see only JDBC url in connection details which works fine.Was anyone able to connect using ODBC url? Can someone please help?

  • 6571 Views
  • 10 replies
  • 7 kudos
Latest Reply
Sumit_Kumar
New Contributor III
  • 7 kudos

Hi,Can you please try to connect once after disabling VPN in your local system (if its enabled)?Thanks.

  • 7 kudos
9 More Replies
Carkis7
by New Contributor II
  • 3781 Views
  • 4 replies
  • 6 kudos

Databricks SQL Option

Hello Everyone,I want you to ask how can I get the SQL option on Databricks, because I am doing the Data Analyst courses and I do not have that option, just Data Engineer and Machine Learning. I am connecting through Microsoft Azure..Waiting for your...

  • 3781 Views
  • 4 replies
  • 6 kudos
Latest Reply
Hemant
Valued Contributor II
  • 6 kudos

@Luis Carcaño​  You can switch your persona from data science and engineering to SQL, but this is only possible if you have a premium Databricks workspace. To do so, please create a new workspace with a premium tier.

  • 6 kudos
3 More Replies
sensanjoy
by Contributor
  • 10888 Views
  • 10 replies
  • 4 kudos

Resolved! Databricks SQL restful API to query delta table

As of today, can we use any Databricks SQL Restful API to query Delta Tables stored in ADLS from any external UI?There is some information mentioned over this link https://docs.databricks.com/sql/api/index.html? but not sure how to use them!!Checked ...

  • 10888 Views
  • 10 replies
  • 4 kudos
Latest Reply
apingle
Contributor
  • 4 kudos

I just saw this today.. https://www.databricks.com/blog/2023/03/07/databricks-sql-statement-execution-api-announcing-public-preview.html

  • 4 kudos
9 More Replies
vinaykumar
by New Contributor III
  • 5252 Views
  • 4 replies
  • 6 kudos

SQL Query execution plan explain and optimize the performance for query run.

When we executing SQL query in databricks SQL warehouse editor what will be best practices to optimize the execution plan and get result faster

  • 5252 Views
  • 4 replies
  • 6 kudos
Latest Reply
Anonymous
Not applicable
  • 6 kudos

Hi @vinay kumar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...

  • 6 kudos
3 More Replies
User16826992666
by Valued Contributor
  • 4635 Views
  • 3 replies
  • 9 kudos

Resolved! Databricks SQL Endpoint start times

When I first login and start using Databricks SQL, the endpoints always take a while to start. Is there anything I can do to improve the cold start experience on the platform?

  • 4635 Views
  • 3 replies
  • 9 kudos
Latest Reply
Anonymous
Not applicable
  • 9 kudos

Could you share your specific use case? May I help you

  • 9 kudos
2 More Replies
mehdi1
by New Contributor III
  • 4464 Views
  • 7 replies
  • 3 kudos

Does Databricks SQL support Azure SQL DB?

Hi,I could create spark tables based on SQL server (Azure SQL actually), and query the tables from a notebook.On another hand, I can see the tables listed in the hive metastore in Databricks SQL. However when I try to query the tables there, it says ...

  • 4464 Views
  • 7 replies
  • 3 kudos
Latest Reply
saltuk
Contributor
  • 3 kudos

@Kaniz Fatma​ @Prabakar Ammeappin​ I do not know if you aware of what @bhumi shamra​  published above? this comments are irrelevant ..

  • 3 kudos
6 More Replies
tariqph
by New Contributor II
  • 3451 Views
  • 6 replies
  • 1 kudos

SQL endpoint vCPU on Azure

How do I change the vCPU type for SQL Endpoint on Azure Databricks? Currently it picks as default DSv4 CPUs which reaches its quota limit although I have unused quota in other vCPU types. I faced similar issue while using Delta live tables but I was ...

  • 3451 Views
  • 6 replies
  • 1 kudos
Latest Reply
Prabakar
Databricks Employee
  • 1 kudos

Hi @Tarique Anwar​ , I don't think changing the vCPU type, for now, is possible. However, I can check with the product team on this.https://docs.microsoft.com/en-us/azure/databricks//sql/admin/sql-endpoints#required-azure-vcpu-quota

  • 1 kudos
5 More Replies
User16826992666
by Valued Contributor
  • 3316 Views
  • 3 replies
  • 0 kudos

Resolved! Is it possible to break down the cost per endpoint in Databricks SQL?

Need some advice for managing my SQL environment and handling internal chargebacks to the teams using the endpoint.

  • 3316 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Thank you for sharing your valuable solution, it's work properly.LiveTheOrangeLife

  • 0 kudos
2 More Replies
jwilliam
by Contributor
  • 9793 Views
  • 5 replies
  • 10 kudos
  • 9793 Views
  • 5 replies
  • 10 kudos
Latest Reply
BilalAslamDbrx
Databricks Employee
  • 10 kudos

Great question! There are similarities and differences:SimilaritiesPhoton is enabled on bothYou have Databricks Runtime on bothDifferencesDatabricks Runtime (DBR) version is managed and auto-upgraded in Databricks SQL. Because SQL is a narrower workl...

  • 10 kudos
4 More Replies
Labels