Schedule & Triggers

Leog — Wed, 19 Mar 2025 20:12:51 GMT

Hi guys, having some issue when I use Schedule and trigger in workflow when file arrives condition, if a place a file with same name it won't trigger is there any configuration I need to do in databricks? thanks

Re: Schedule & Triggers

mmayorga — Wed, 19 Mar 2025 23:49:40 GMT

Hi @Leog

Thank you for reaching out and for your sending your question.

Per the documentation: https://docs.databricks.com/gcp/en/jobs/file-arrival-triggers

Only new files trigger runs. Overwriting an existing file with a file of the same name does not trigger a run.

Here are some options:

Rename your file and place it in the configured location for the job to trigger.
Delete your previous file, then place it again. Please be aware that this must be done considering every job execution; don't do it in the same file validation/verification cycle; otherwise, it won't be picked up.

Thank you

topic Schedule & Triggers in Data Engineering

Schedule & Triggers

Re: Schedule & Triggers