Hello Kaniz Fatma,
I'm new at databricks and I have the exact same error after I created an External Location and attached my Notebook script to my Delta Live Tables pipeline. When I press "validate," it throws that error at the "waiting for resources" step in the DLT graph.
This is my DLT status workflow:
This is the msg log error:
DataPlaneException: [DLT ERROR CODE: CLUSTER_LAUNCH_FAILURE.CLIENT_ERROR] Failed to launch pipeline cluster aaaaa-bbbbb-cccc with termination code AWS_AUTHORIZATION_FAILURE and termination type CLIENT_ERROR: Could not launch cluster due to cloud provider authorization failure. databricks_error_message: Failure happened when talking to AWS, AWS API error code: AccessDenied AWS error message: User: arn:a...
My guess is that I'm missing some additional cluster authorization in AWS (IAM) for DLT that I couldn't find in the Databricks documentation.
Thanks,
Alvaro