cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks Auto Loader authorization exception

v01d
New Contributor III

Hello,
I'm trying to process the DB Auto Loader with notifications=true option (Azure ADLS) and get not clear authorization error. The exception log attached.
Looks like all required permission are provided to the service principle:

Screenshot_2024-06-01_at_14_32_06.png

1 REPLY 1

v01d
New Contributor III

This service principle has all required permissions, and it successfully reads/writes to this ADLS. But in the cloudFiles.useNotifications=true mode, it throws the exception. I double-checked the required permissions, everything looks good.
I checked also the subscription Resource provider for DataGrid, it's permitted.
The exception log is too common.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group