Databricks Auto Loader authorization exception
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ06-01-2024 05:11 AM
Hello,
I'm trying to process the DB Auto Loader with notifications=true option (Azure ADLS) and get not clear authorization error. The exception log attached.
Looks like all required permission are provided to the service principle:
โ
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ06-03-2024 06:54 AM - edited โ06-03-2024 07:06 AM
This service principle has all required permissions, and it successfully reads/writes to this ADLS. But in the cloudFiles.useNotifications=true mode, it throws the exception. I double-checked the required permissions, everything looks good.
I checked also the subscription Resource provider for DataGrid, it's permitted.
The exception log is too common.

