cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Declarative Pipeline Failure for Autoloader

iskidet
New Contributor

Hello Folks, 

After moving my working serverless Auto Loader notebook to a declarative (DLT) pipeline, I’m getting an AccessDenied error. What could be causing this?”

iskidet_1-1759326363933.png

here is the DLT json  and error message in the DLT

iskidet_4-1759326671286.png

iskidet_5-1759327166901.png

 

iskidet_2-1759326493353.png

I googled around got saw some hint that DLT is trying to write to some staging temporary without, permission not which other permission, I should be adding.

@MohanaBasak

Thank you all.

Samson

 

 

1 REPLY 1

nayan_wylde
Honored Contributor III

Seems to me like the SPN or individual running the DLT pipeline need to have access on the external location and the main catalog. 

GRANT ALL PRIVILEGES ON CATALOG <catalog_name> TO `<external_account_identifier>`;

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now