Hubert-Dudek
Databricks MVP

There is a way to do that using terraform but it will be complicated... https://github.com/databrickslabs/terraform-provider-databricks

If you need something less complicated: for jobs cluster is easy just set task on which all others will depend.

Another way which I think of is to set the azure function which runs every minute and checks for new running clusters and then triggers their notebook.

In Azure using event grid and logic apps you can also monitor new VM deployment ad than trigger notebook.


My blog: https://databrickster.medium.com/