cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DataFrame vs. Spark SQL

SamAWS
New Contributor III

When should I use DataFrame over Spark SQL?

If DataFrame is better, then why do I need Spark SQL?

1 REPLY 1

shan_chandra
Databricks Employee
Databricks Employee

@SamAWS - when you want to query the underlying data in the dataframe by creating a view or table, Spark SQL is preferred. Same can be achieved using pyspark by retaining them as a dataframe. Spark SQL is used by wider audience and easy to develop.