topic Re: Trigger file_arrival of job on Delta Lake table change in Data Engineering

Trigger file_arrival of job on Delta Lake table change

zsucic1 — Thu, 06 Jul 2023 11:08:00 GMT

Is there a way to avoid having to create an external data location Simply to trigger a job when new data comes to a specific Delta Lake table?

Re: Trigger file_arrival of job on Delta Lake table change

Ajay-Pandey — Fri, 07 Jul 2023 07:33:19 GMT

Hi @zsucic1 ,

For now, there is only external location is supported for file arrival trigger

Trigger jobs when new files arrive - Azure Databricks | Microsoft Learn

Re: Trigger file_arrival of job on Delta Lake table change

Anonymous — Wed, 12 Jul 2023 09:44:14 GMT

Hi @zsucic1

Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.

Cheers!