Hi everyone,
I'm planning to implement Azure Databricks Auto Loader using the Databricks-managed file notification mode for an external location registered in Unity Catalog. I understand this feature is currently in public preview, and Iโd love to hear from anyone who has already implemented it.
- Have you successfully set this up?
- What steps did you follow to enable managed file notifications for an external location?
- Were there any specific IAM or Unity Catalog configurations required?
- What limitations should I be aware of while using this mode?
- Any best practices or lessons learned you can share?