I recently saw a business case in which an external orchestrator accounted for nearly 30% of their total Databricks job costs. That's when it hit me: we're often paying a premium for complexity we don't need. Besides FinOps, I tried to gather all the reasons on my blogs for why Lakeflow should be your primary orchestrator.
Read more:
https://www.sunnydata.ai/blog/lakeflow-jobs-default-databricks-orchestrator
Announcements
