cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Data bricks SQL is allowing 10 queries only ?

Saikrishna2
New Contributor III

โ€ขPower BI is a publisher that uses AD group authentication to publish result sets. Since the publisher's credentials are maintained, the same user can access the data bricks database.

โ€ขNumber of the users are retrieving the data from the power bi or if any report started from the same user the user SQL's are queuing state.

โ€ขThe first 10 queries that we looked into were executing concurrently, and once any of the first 10 SQL statements were finished, the 11th query was launched.

7 REPLIES 7

Unforgiven
Valued Contributor III

Hi @Sai Krishna Cheruvuโ€‹ Just give you some info

https://docs.databricks.com/sql/get-started/admin-set-up-user-to-query-table.html

https://docs.databricks.com/sql/get-started/user-quickstart.html

give some info maybe helpful in this case

LaurentLeturgez
New Contributor III
New Contributor III

Hi @Sai Krishna Cheruvuโ€‹ 

If you haven't configured your warehouse with an autoscale capacity (min clusters = max clusters = 1), you have probably filled the queue with your first 10 queries (See. https://learn.microsoft.com/en-us/azure/databricks/sql/admin/sql-endpoints#queueing-and-autoscaling or the equivalence according your cloud provider).

If those 10 queries are big ones, you should increase your autoscale capacity and depending on these queries' execution profile, Databricks will automatically upscale your warehouse to deliver the expected concurrency level according the algorithm given in the documentation.

HTH

Laurent

youssefmrini
Honored Contributor III
Honored Contributor III

Each endpoint Can have maximum 10 concurrent queries else they are going to be queued.

Ajay-Pandey
Esteemed Contributor III

That's right

tunstila
Contributor II

You can only run 10 concurrent queries I think.

Own
Contributor

You can call notebook from a notebook for nesting and increase concurrency.โ€‹

VaibB
Contributor

I believe 10 is a limit as of now. See if you can increase the concurrency limit from the source.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.