topic Can't "run all below" - "command is part of a batch that is still running" in Data Engineering

Can't "run all below" - "command is part of a batch that is still running"

dkxxx-rc — Mon, 31 Mar 2025 20:21:30 GMT

Weirdness in Databricks on AWS. In a notebook that is doing absolutely nothing, I click the "Run All Above" or "Run All Below" button on a cell, and it won't do anything at all except pop up a little message near the general "Run All" button, saying "Command is part of a batch that is still running. Please wait or interrupt current execution." The pop-up disappears in about a second.

There is nothing to interrupt. Furthermore, if I click "Run All", it starts running everything, no problem.

What's happening?

(See message in screenshot.)

Re: Can't "run all below" - "command is part of a batch that is still running"

Advika — Fri, 04 Apr 2025 12:35:42 GMT

Hello @dkxxx-rc!

Can you check if any background processes are still running in your notebook that might be interfering with new executions?
If you are using Databricks Runtime 14.0 or above, cells run in batches, so any error halts execution, and individual cells can't be cancelled, you'd need to interrupt and restart the entire batch.

Re: Can't "run all below" - "command is part of a batch that is still running"

dkxxx-rc — Tue, 08 Apr 2025 16:05:12 GMT

I had restarted the notebook and the cluster, so I'm doubtful about it having been hidden background processes. The problem has not recurred in the days since I posted this topic, for what it's worth.