topic Re: Data bricks SQL is allowing 10 queries only ? in Data Engineering

Data bricks SQL is allowing 10 queries only ?

Saikrishna2 — Tue, 22 Nov 2022 16:03:53 GMT

•Power BI is a publisher that uses AD group authentication to publish result sets. Since the publisher's credentials are maintained, the same user can access the data bricks database.

•Number of the users are retrieving the data from the power bi or if any report started from the same user the user SQL's are queuing state.

•The first 10 queries that we looked into were executing concurrently, and once any of the first 10 SQL statements were finished, the 11th query was launched.

Re: Data bricks SQL is allowing 10 queries only ?

Unforgiven — Wed, 23 Nov 2022 03:00:25 GMT

Hi @Sai Krishna Cheruvu Just give you some info

https://docs.databricks.com/sql/get-started/admin-set-up-user-to-query-table.html

https://docs.databricks.com/sql/get-started/user-quickstart.html

give some info maybe helpful in this case

Re: Data bricks SQL is allowing 10 queries only ?

LaurentLeturgez — Sun, 27 Nov 2022 16:27:14 GMT

Hi @Sai Krishna Cheruvu

If you haven't configured your warehouse with an autoscale capacity (min clusters = max clusters = 1), you have probably filled the queue with your first 10 queries (See. https://learn.microsoft.com/en-us/azure/databricks/sql/admin/sql-endpoints#queueing-and-autoscaling or the equivalence according your cloud provider).

If those 10 queries are big ones, you should increase your autoscale capacity and depending on these queries' execution profile, Databricks will automatically upscale your warehouse to deliver the expected concurrency level according the algorithm given in the documentation.

HTH

Laurent

Re: Data bricks SQL is allowing 10 queries only ?

youssefmrini — Fri, 02 Dec 2022 08:43:21 GMT

Each endpoint Can have maximum 10 concurrent queries else they are going to be queued.

Re: Data bricks SQL is allowing 10 queries only ?

tunstila — Fri, 02 Dec 2022 12:07:17 GMT

You can only run 10 concurrent queries I think.

Re: Data bricks SQL is allowing 10 queries only ?

Own — Fri, 02 Dec 2022 12:08:42 GMT

You can call notebook from a notebook for nesting and increase concurrency.

Re: Data bricks SQL is allowing 10 queries only ?

VaibB — Fri, 02 Dec 2022 20:26:24 GMT

I believe 10 is a limit as of now. See if you can increase the concurrency limit from the source.

Re: Data bricks SQL is allowing 10 queries only ?

Ajay-Pandey — Mon, 05 Dec 2022 08:31:52 GMT

That's right