https://community.databricks.com/t5/get-started-discussions/dlt-pipeline-issue-with-new-version-of-advanced-data-engineering/m-p/57368#M8254 <P>I am currently taking the new Advanced Data Engineering with Databricks training. I am stuck in the Demo: Auto Load to Bronze section of Streaming ETL Patterns with DLT. Looks to be an access issue to AWS as the pipeline errors out with the following:</P><P>DataPlaneException: [DLT ERROR CODE: CLUSTER_LAUNCH_FAILURE.CLIENT_ERROR] Failed to launch pipeline cluster 0115-031151-am1n1gme with termination code AWS_AUTHORIZATION_FAILURE and termination type CLIENT_ERROR: Could not launch cluster due to cloud provider authorization failure. databricks_error_message: Failure happened when talking to AWS, AWS API error code: UnauthorizedOperation AWS error message: Yo...</P><P>Has anyone had this issue with the new version of Advanced Data Engineering with Databricks training?</P> Mon, 15 Jan 2024 15:53:04 GMT Artman23 2024-01-15T15:53:04Z https://community.databricks.com/t5/get-started-discussions/dlt-pipeline-issue-with-new-version-of-advanced-data-engineering/m-p/57368#M8254 <P>I am currently taking the new Advanced Data Engineering with Databricks training. I am stuck in the Demo: Auto Load to Bronze section of Streaming ETL Patterns with DLT. Looks to be an access issue to AWS as the pipeline errors out with the following:</P><P>DataPlaneException: [DLT ERROR CODE: CLUSTER_LAUNCH_FAILURE.CLIENT_ERROR] Failed to launch pipeline cluster 0115-031151-am1n1gme with termination code AWS_AUTHORIZATION_FAILURE and termination type CLIENT_ERROR: Could not launch cluster due to cloud provider authorization failure. databricks_error_message: Failure happened when talking to AWS, AWS API error code: UnauthorizedOperation AWS error message: Yo...</P><P>Has anyone had this issue with the new version of Advanced Data Engineering with Databricks training?</P> Mon, 15 Jan 2024 15:53:04 GMT https://community.databricks.com/t5/get-started-discussions/dlt-pipeline-issue-with-new-version-of-advanced-data-engineering/m-p/57368#M8254 Artman23 2024-01-15T15:53:04Z https://community.databricks.com/t5/get-started-discussions/dlt-pipeline-issue-with-new-version-of-advanced-data-engineering/m-p/88748#M8257 <P>Hello Kaniz Fatma,</P><P>I'm new at databricks and I have the exact same error after I created an External Location and attached my Notebook script to my Delta Live Tables pipeline. When I press "validate," it throws that error at the "waiting for resources" step in the DLT graph.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="AlvaroCM_1-1725545317822.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/10958iA7C005398CEA0717/image-size/medium?v=v2&amp;px=400" role="button" title="AlvaroCM_1-1725545317822.png" alt="AlvaroCM_1-1725545317822.png" /></span></P><P>This is my DLT status workflow:</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="AlvaroCM_2-1725545623357.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/10959i80200B1FBC67ED8A/image-size/medium?v=v2&amp;px=400" role="button" title="AlvaroCM_2-1725545623357.png" alt="AlvaroCM_2-1725545623357.png" /></span></P><P>This is the msg log error:<BR /><FONT size="2"><EM>DataPlaneException: [DLT ERROR CODE: CLUSTER_LAUNCH_FAILURE.CLIENT_ERROR] Failed to launch pipeline cluster aaaaa-bbbbb-cccc with termination code AWS_AUTHORIZATION_FAILURE and termination type CLIENT_ERROR: Could not launch cluster due to cloud provider authorization failure. databricks_error_message: Failure happened when talking to AWS, AWS API error code: AccessDenied AWS error message: User: arn:a...</EM></FONT></P><P>&nbsp;</P><P>My guess is that I'm missing some additional cluster authorization in AWS (IAM) for DLT that I couldn't find in the Databricks documentation.</P><P>Thanks,</P><P>Alvaro</P> Thu, 05 Sep 2024 14:19:06 GMT https://community.databricks.com/t5/get-started-discussions/dlt-pipeline-issue-with-new-version-of-advanced-data-engineering/m-p/88748#M8257 AlvaroCM 2024-09-05T14:19:06Z