There are several approaches here. You can write an automation script that programmatically accesses Databricks API’s to generate configured jobs. You can also utilize the Databricks Terraform provider. The benefit of the latter approach is that Terraform maintains the infrastructure state, so making changes to jobs after-the-fact is much simpler.
