cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Maximum job execution per hour

RicksDB
Contributor II

Hi,

what is the maximum number of jobs we can execute in an hour for a given workspace?

This page mentions 5000

https://docs.microsoft.com/en-us/azure/databricks/data-engineering/jobs/jobs

  • The number of jobs a workspace can create in an hour is limited to 5000 (includes “run now” and “runs submit”). This limit also affects jobs created by the REST API and notebook workflows.

This page mentions 1000

https://docs.microsoft.com/en-us/azure/databricks/resources/limits

  • JobsCreated per hour 1000

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Sivaprasad1
Valued Contributor II

Up to 5000 jobs (both normal and ephemeral) may be created per hour in a single workspace

View solution in original post

3 REPLIES 3

Sivaprasad1
Valued Contributor II

Up to 5000 jobs (both normal and ephemeral) may be created per hour in a single workspace

Thank you for sharing this information. Making this response as the "best" response.

Kaniz_Fatma
Community Manager
Community Manager

Hi @E H​  , We haven’t heard from you on the last response from @Sivaprasad C S​, and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please share it with the community as it can be helpful to others.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!