02-18-2022 08:08 AM
Its all about spinning the spark cluster and both spark Sql api and databricks does the same operation what difference does it make to BI tools ?
02-19-2022 12:38 AM
Hi @Basavaraj Angadi ! There's a huge difference between Spark SQL and Databricks SQL endpoints. To name a few:
In short, I would definitely recommend using SQL endpoints. They're just better for BI in every possible way!
02-18-2022 12:19 PM
Hi, @Basavaraj Angadi - My name is Piper, and I'm a moderator for Databricks. Thank you for coming to the community with your question. Let's give it a while for the community to respond. We'll circle back to this if we need to.
02-18-2022 11:21 PM
@Piper Wilson Thanks a lot.........Looking forward for the answers because it helps us to make a swtich from Spark SQL api to Databricks when connecting to BI tool.
02-19-2022 12:38 AM
Hi @Basavaraj Angadi ! There's a huge difference between Spark SQL and Databricks SQL endpoints. To name a few:
In short, I would definitely recommend using SQL endpoints. They're just better for BI in every possible way!
02-19-2022 03:38 PM
Hey Bilal,
(1) and (3) are available in databricks sql as well, right?
Results are cached on cluster and you can now spin up a photon cluster as well in high concurrency mode.
In my opinion, SQL endpoints are fast but expensive as compared to datarbricks cluster (in terms of DBU).
03-01-2022 05:26 AM
@Aman Sehgal the elastic load balancer is only available in SQL endpoints.
02-22-2022 02:29 PM
Thanks @Bilal Aslam and @Aman Sehgal for jumping in!
@Basavaraj Angadi I want to make sure you got your question(s) answered! Will you let us know? Don't forget, you can select any reply as the "best answer" ! 😊
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.