Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-18-2021 03:01 AM
When you say 'pipeline' I assume you mean a Data Factory Pipeline.
You can do this by setting the 'Timeout' value in the General-tab of the Databricks Notebook activity.
By default this is 7 days I think, you can set it to 15 minutes.
This will throw an error in ADF, so make sure you let the subsequent activities to be processed (the blue arrow or red one).
One thing I am not sure of is if the actual databricks run is cancelled too by ADF, or that only the ADF activity is cancelled (while in databricks the notebook keeps running). That is easy to test though.