topic Re: Where is Databricks Tunnel (and is Databricks connect cool again?) in Data Engineering

Where is Databricks Tunnel (and is Databricks connect cool again?)

Erik — Fri, 12 Aug 2022 18:30:43 GMT

Two related questions:

1: There has been several mentions in this forum about "Databricks Tunnel", which should allow us to connect from our local IDE to a remote databricks cluster and develop stuff locally. The roumors said early 2022, is there some update ETA?

2: What is the relationship between "Spark connect", "Databricks connect" and "Databricks tunnel"? Databricks connect has existed for a while, but Databricks has actively recommended people to not use it, and has stated that they "[...] plans no new feature development for [it]". But now a month ago Spark connect was announced, and it sounds like its pretty much Databricks connect? Can you guys maybe clear up a bit what the roles for these different tools are, which one will actually be developed, and how we will be able to develop locally from our IDE in the future?

Re: Where is Databricks Tunnel (and is Databricks connect cool again?)

youssefmrini — Wed, 24 Aug 2022 07:53:02 GMT

Databricks tunnel has been deprecated. Instead you can use DBX or in few weeks/months we will have a visual studio extension to write code in your laptop and get the benefit of Databricks cluster

Re: Where is Databricks Tunnel (and is Databricks connect cool again?)

Vidula — Sun, 11 Sep 2022 07:10:58 GMT

Hi there @Erik Parmann

Does @Youssef Mrini response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?

We'd love to hear from you.

Thanks