topic Re: Delete files from databricks Volumes based on trigger in Data Engineering

Delete files from databricks Volumes based on trigger

amitkamthane — Wed, 02 Apr 2025 23:57:50 GMT

Hi,

I noticed there's a file arrival trigger option in the workflow but cant see delete trigger option. However, let's say I want to delete files from the Databricks volume based on this trigger, and also remove the corresponding records from the bronze, silver, gold, and vector search index tables. How can we achieve this using the trigger mechanism?

Re: Delete files from databricks Volumes based on trigger

Louis_Frolio — Thu, 03 Apr 2025 17:15:37 GMT

Currently, Databricks doesn’t offer a built-in file deletion trigger mechanism similar to the file arrival trigger. The file arrival trigger only monitors for new files being added to a location, not for files being deleted.

Re: Delete files from databricks Volumes based on trigger

amitkamthane — Thu, 03 Apr 2025 21:39:29 GMT

Yes, thats correct but how to do it if we want to implement delete trigger on databricks volume?

Re: Delete files from databricks Volumes based on trigger

Louis_Frolio — Fri, 04 Apr 2025 14:17:25 GMT

You can't at this time. It is not a feature in Databricks. Cheers, Louis.