Hey!

I hope I’m not too late, and I’d like to share my opinion. While it’s true that managed services offer certain advantages over external tables, you should keep in mind that Databricks services often come with an associated cost, such as Predictive Optimization. I recommend reviewing your workflow and checking the associated costs here: Databricks Pricing.

It’s important to note that Databricks operates on a pay-as-you-go model, but in most cases, having control over the service and being able to manage resources through your cloud provider—for example, horizontal autoscaling, cluster size adjustments, etc.—often results in a lower overall bill. I recommend conducting a cost analysis to determine which processes could benefit from migrating to managed services and which ones might not be worth it.

In general, managed services provide better performance, optimization, and enhanced governance and security controls, including support for serverless jobs, but everything comes at a much higher cost.

🙂