Implementing ADB Autoloader with Managed File Notification Mode for UC Ext Location (public preview)

saicharandeepb
Contributor

Hi everyone,
I'm planning to implement Azure Databricks Auto Loader using the Databricks-managed file notification mode for an external location registered in Unity Catalog. I understand this feature is currently in public preview, and I’d love to hear from anyone who has already implemented it.

  • Have you successfully set this up?
  • What steps did you follow to enable managed file notifications for an external location?
  • Were there any specific IAM or Unity Catalog configurations required?
  • What limitations should I be aware of while using this mode?
  • Any best practices or lessons learned you can share?