- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-26-2024 12:10 AM - edited 07-26-2024 12:10 AM
Hi @guangyi ,
In DLT you have following two properties that you can set:
pipelines.maxFlowRetryAttempts Type: int The maximum number of attempts to retry a flow before failing a pipeline update when a retryable failure occurs. The default value is two. By default, when a retryable failure occurs, the Delta Live Tables runtime attempts to run the flow three times including the original attempt. |
pipelines.numUpdateRetryAttempts Type: int The maximum number of attempts to retry an update before failing the update when a retryable failure occurs. The retry is run as a full update. The default is five. This parameter applies only to triggered updates run in production mode. There is no retry when your pipeline runs in development mode. |
You can also take a look on below answers:
- Delta Live Tables - RETRY_ON_FAILURE - Databricks Community - 5926
- Solved: DLT Pipeline Retries - Databricks Community - 30388