cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

workflow set maximum queued items

dcrezee
New Contributor III

Hi all,

I have a question regarding Workflows and queuing of job runs. I'm running into a case where jobs are running longer than expected and result in job runs being queued, which is expected and desired. However, in this particular case we only need a single job run to be queued and don't need potentially dozens of job runs to be queued. A single job run would suffice to recover in this particular case.

Is possible to configure a maximum amount of queued job runs?

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Walter_C
Databricks Employee
Databricks Employee

Unfortunately there is no way to control the number of jobs that will be moved to queue status when queuing is enabled.

View solution in original post

1 REPLY 1

Walter_C
Databricks Employee
Databricks Employee

Unfortunately there is no way to control the number of jobs that will be moved to queue status when queuing is enabled.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group