Delete files from databricks Volumes based on trigger

amitkamthane
New Contributor II

Hi,

I noticed there's a file arrival trigger option in the workflow but cant see delete trigger option. However, let's say I want to delete files from the Databricks volume based on this trigger, and also remove the corresponding records from the bronze, silver, gold, and vector search index tables. How can we achieve this using the trigger mechanism?

Louis_Frolio
Databricks Employee
Databricks Employee

Currently, Databricks doesn’t offer a built-in file deletion trigger mechanism similar to the file arrival trigger. The file arrival trigger only monitors for new files being added to a location, not for files being deleted.

View solution in original post

Yes,  thats correct but how to do it if we want to implement delete trigger on databricks volume?

 

You can't at this time. It is not a feature in Databricks.  Cheers, Louis.