cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to stop a continuous pipeline which is set to RETRY on FAILURE and failing for some reason

ziafazal
New Contributor II

I have created a pipeline which is continuous and set to RETRY on FAILURE. For some reason it keeps failing and retrying. Is there any way I can stop it. Hitting Stop button throws an error.

3 REPLIES 3

szymon_dybczak
Contributor III

Hi @ziafazal ,

If UI doesn't work you can try use REST API:

https://docs.databricks.com/api/azure/workspace/pipelines/stop

ziafazal
New Contributor II

Hi @szymon_dybczak 

I already tried to remove it via REST API but got same error as in the pipeline logs. Eventually, I had to remove workspace to get rid of it.

Sorry to hear that you needed to remove workspace. Anyway, weird big.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group