Hi @Datalight ,

1. You can use file arrival triggers for such scenario

 Trigger jobs when new files arrive - Azure Databricks | Microsoft Learn

2. This is too broadly stated question. We don't know anything on your current setup. For instance, does your workspace VNET Injected with SCC enabled? 

3. I would put them in separate folde (especially if their schema differs)