vida
Databricks Employee
Databricks Employee

Hi Dan,

Spark SQL is based on HiveQL. It allows you to use SQL syntax to do big data, like count your data. It does not, however, support operations like delete and update. I cover why in my talk here:

https://spark-summit.org/east-2016/events/not-your-fathers-database-how-to-use-apache-spark-properly...

-Vida