Thank you @Alberto_Umana. I am happy to make it a scheduled workflow that runs every minute. I have set concurrency to 1, but will that keep subsequent jobs from queueing up? If not, is there some other way to stop Databricks from queueing a subsequent job while a previous job is running? I don't think it's absolutely required; I am just trying to avoid a scenario where a job becomes long running and the job queue starts filling up.