daniel_sahal
Databricks MVP

@Kjetil Since they are getting updated often then IMO making a copy would make sense.

What you could try is to create Microsoft.Storage.BlobCreated event to replicate the .CSV into the secondary bucket.

However, best practice would be to have some kind of incremental approach on the source side - creating a new file instead of appending to the existing one.

View solution in original post