raphaelblg
Databricks Employee
Databricks Employee

 

Hi @camilo_s ,
 
Spark SQL is the SQL API for Spark applications, while Databricks SQL is a product that follows data warehouse principles. You can anticipate performance differences mainly due to the fact that Databricks SQL compute is based on SQL Warehouses (multiple Spark clusters), while Spark SQL relies on the common Spark cluster architecture.
 
Choosing a serverless option may not provide huge processing time enhancements, but it can offer near-instant startup times.
 
I hope this information is helpful. If you have any further questions or need additional clarification, please don't hesitate to ask.
Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks