Hi everyone,
I am trying to build the pipeline but when I run it I receive an error
DataPlaneException: Failed to start the DLT service on the cluster. Please check the driver logs for more details or contact Databricks support.
This is from the driver log: ERROR Uncaught throwable from user code: com.databricks.sql.managedcatalog.UnityCatalogServiceException: [RequestId=d4068d65-d6c3-4070-b056-31cfdcaeb40f ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: AbfsRestOperationException exceptionTraceId=bb83ca0d-09e5-48af-9c96-20e4acb63fa8
at com.databricks.managedcatalog.ErrorDetailsHandler.wrapServiceException(ErrorDetailsHandler.scala:33)
at com.databricks.managedcatalog.ErrorDetailsHandler.wrapServiceException$(ErrorDetailsHandler.scala:23)
at com.databricks.managedcatalog.ManagedCatalogClientImpl.wrapServiceException(ManagedCatalogClientImpl.scala:106)
What does this mean? I am trying with autloader to read the file with cdc logs and also this external location is set up and working properly.
Thanks!