szymon_dybczak
Esteemed Contributor III

Hi @guangyi ,

In DLT you have following two properties that you can set:

pipelines.maxFlowRetryAttempts

Type: int

The maximum number of attempts to retry a flow before failing a pipeline update when a retryable failure occurs.

The default value is two. By default, when a retryable failure occurs, the Delta Live Tables runtime attempts to run the flow three times including the original attempt.

pipelines.numUpdateRetryAttempts

Type: int

The maximum number of attempts to retry an update before failing the update when a retryable failure occurs. The retry is run as a full update.

The default is five. This parameter applies only to triggered updates run in production mode. There is no retry when your pipeline runs in development mode.

You can also take a look on below answers:

Delta Live Tables - RETRY_ON_FAILURE - Databricks Community - 5926

Solved: DLT Pipeline Retries - Databricks Community - 30388




View solution in original post