Delete files from databricks Volumes based on trigger

[amitkamthane]

Hi,

I noticed there's a file arrival trigger option in the workflow but cant see delete trigger option. However, let's say I want to delete files from the Databricks volume based on this trigger, and also remove the corresponding records from the bronze, silver, gold, and vector search index tables. How can we achieve this using the trigger mechanism?

[BigRoux · Accepted solution]

Currently, Databricks doesn’t offer a built-in file deletion trigger mechanism similar to the file arrival trigger. The file arrival trigger only monitors for new files being added to a location, not for files being deleted.

[amitkamthane]

Yes,  thats correct but how to do it if we want to implement delete trigger on databricks volume?

[BigRoux]

You can't at this time. It is not a feature in Databricks.  Cheers, Louis.