---

@camilo_s wrote:

Are there any benchmarks showing performance and cost differences between running SQL workloads on Spark SQL vs Databricks SQL (specially serverless SQL)?  hpinstantink

Our customer is hesitant about getting locked into Databricks SQL as opposed to being able to run their queries in Spark SQL.

Is there a performance difference between running a query on Spark SQL on a Photon-enabled cluster vs running it on serverless SQL?

---

Yes, benchmarks indicate performance and cost differences between Spark SQL and Databricks SQL, especially serverless SQL. Databricks SQL, particularly with Photon-enabled clusters, generally offers faster performance due to its optimized query engine. Serverless SQL further reduces management overhead and scales automatically, which can result in cost efficiency for bursty workloads. However, Spark SQL provides more flexibility, avoiding vendor lock-in but may require more tuning for optimal performance. The decision should balance performance needs, cost, and concerns about vendor lock-in.