cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Data bricks SQL is allowing 10 queries only ?

Saikrishna2
New Contributor III

•Power BI is a publisher that uses AD group authentication to publish result sets. Since the publisher's credentials are maintained, the same user can access the data bricks database.

•Number of the users are retrieving the data from the power bi or if any report started from the same user the user SQL's are queuing state.

•The first 10 queries that we looked into were executing concurrently, and once any of the first 10 SQL statements were finished, the 11th query was launched.

7 REPLIES 7

Unforgiven
Valued Contributor III

LaurentLeturgez
Databricks Employee
Databricks Employee

Hi @Sai Krishna Cheruvu​ 

If you haven't configured your warehouse with an autoscale capacity (min clusters = max clusters = 1), you have probably filled the queue with your first 10 queries (See. https://learn.microsoft.com/en-us/azure/databricks/sql/admin/sql-endpoints#queueing-and-autoscaling or the equivalence according your cloud provider).

If those 10 queries are big ones, you should increase your autoscale capacity and depending on these queries' execution profile, Databricks will automatically upscale your warehouse to deliver the expected concurrency level according the algorithm given in the documentation.

HTH

Laurent

youssefmrini
Databricks Employee
Databricks Employee

Each endpoint Can have maximum 10 concurrent queries else they are going to be queued.

Ajay-Pandey
Esteemed Contributor III

That's right

Ajay Kumar Pandey

tunstila
Contributor II

You can only run 10 concurrent queries I think.

Own
Contributor

You can call notebook from a notebook for nesting and increase concurrency.​

VaibB
Contributor

I believe 10 is a limit as of now. See if you can increase the concurrency limit from the source.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group