topic Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point in DELETE

Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

BasavarajAngadi — Sun, 27 Feb 2022 10:40:42 GMT

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

Hubert-Dudek — Sun, 27 Feb 2022 14:05:30 GMT

Hive metastore is semantic layer, it is like mapping so you have folder with delta or json etc. and it is mapped as table so you can query your data using SQL syntax.

SQL endpoint is is server address for incoming SQL queries (like jdbc/odbc) so you can query tables registered in hive metastore from any application (PowerBI, qlikview, looker, or just from own code using jdbc/odbc driver)

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

Anonymous — Mon, 28 Feb 2022 12:54:50 GMT

What Hubert said is correct. I'd also add that Apache Hive is an old/obsolete tool created at Facebook and open sourced that was a SQL interface for MapReduce. https://hive.apache.org/

It's often helpful to think of SparkSQL as the modern or evolved version of Hive.

SQL Endpoint is more of a cluster to run SQL queries on https://docs.databricks.com/sql/admin/sql-endpoints.html

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

BasavarajAngadi — Mon, 28 Feb 2022 13:19:39 GMT

@Joseph Kambourakis hi can we not run hive queries with Spark as execution engine ? what difference does it make when compared with data bricks SQL end point ... apart from delta engine .

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

Anonymous — Mon, 28 Feb 2022 13:47:09 GMT

Yes, in later updates Hive did get a Spark backend engine, but at that time it was largely obsolete.

SQL endpoints have many advantages. They are cloud optimized and there is a C++ engine (photon) that is faster than the traditional spark engine. The endpoints are more compute environments, where hive was more of a syntax and query engine. Also, Spark SQL became more Ansi compatible in recent releases. https://spark.apache.org/docs/latest/sql-ref-ansi-compliance.html

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

Anonymous — Tue, 08 Mar 2022 21:50:48 GMT

@Basavaraj Angadi - Does @Joseph Kambourakis's response answer your question well enough to mark it as best? If not, how may we help you more?

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

Anonymous — Tue, 29 Mar 2022 10:13:34 GMT

Thank you for sharing your valuable solution, it's work properly.

lowes employee portal

Re: Hi experts , I am new to data bricks and want to know what is the difference between HIVE vs Databricks SQL end point

Hubert-Dudek — Tue, 29 Mar 2022 10:50:50 GMT

Great to hear 🙂