stbjelcevic
Databricks Employee
Databricks Employee

Yes: use Auto Loader’s UC-managed file events in DLT with DBR 14.3 LTS or later; enable file events on the UC external location and set managed file events in the stream. This avoids the legacy file notifications’ single-user compute limitation and works with UC-managed tables.

  • File events for Auto Loader on UC are supported on DBR 14.3+ and recommended over directory listing for performance/cost.

  • The “single-user only” limitation applies to legacy per-stream file notifications, not to UC-managed file events.

  • Run your streams at least every seven days to avoid fallback directory listing; changing source paths isn’t supported in notification mode.

  • If you can’t enable file events, directory listing still works (incremental listing is deprecated—leave it off).