cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

workflow set maximum queued items

Anonymous
Not applicable

Hi all,

I have a question regarding Workflows and queuing of job runs. I'm running into a case where jobs are running longer than expected and result in job runs being queued, which is expected and desired. However, in this particular case we only need a single job run to be queued and don't need potentially dozens of job runs to be queued. A single job run would suffice to recover in this particular case.

Is possible to configure a maximum amount of queued job runs?

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Walter_C
Databricks Employee
Databricks Employee

Unfortunately there is no way to control the number of jobs that will be moved to queue status when queuing is enabled.

View solution in original post

1 REPLY 1

Walter_C
Databricks Employee
Databricks Employee

Unfortunately there is no way to control the number of jobs that will be moved to queue status when queuing is enabled.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now