Some time ago I've been looking for the very same answers and this is what I found/did back then:

• https://menziess.github.io/howto/ - my source of inspiration (tech part)
• https://databricks.com/blog/2017/10/30/continuous-integration-continuous-delivery-databricks.html - based on that I've been trying to set up some process-wise baseline
• https://github.com/pawelmitrus/azure-databricks-cicd-notebooks - my own idea of solving the problem of CI/CD for the very common projects, using notebooks for running ETLs (it's kind of a mix of all above)

I'd be happy to discuss