Databricks Community

If users are allowed to create clusters, how can an operations team prevent them from consuming excessive costs?

When using Azure Data Factory to coordinate the launch of Databricks jobs - can you specify which cluster policy to apply to the job, either explicitly or implicitly?

When using Airflow to co-ordinate execution of jobs, what are the applicable limits?

I have a DB-savvy customer who is concerned their silver/gold layer is becoming too expensive.  These layers are heavily denormalized, focused on logical business entities (customers, claims, services, etc), and maintained by MERGEs.  They cannot pre...