topic Re: Connect to databricks from external non-spark cluster in Administration & Architecture

Connect to databricks from external non-spark cluster

Ishmael — Tue, 14 Nov 2023 04:34:29 GMT

Hi,

I have an app/service on a non-spark kubernetes cluster. Is there a way to access/query a databricks service from my app/service? I see documentations on connectors, particularly on scala which is the code of my app/service. Can I use these connectors from outside the databricks cluster?

Re: Connect to databricks from external non-spark cluster

Ishmael — Tue, 14 Nov 2023 08:19:27 GMT

Thanks Kaniz. I am checking this out. Is this right that it only currently supports scala 2.12? I'm using Scala 2.13 so this might be a problem. Is there an alternative?

Re: Connect to databricks from external non-spark cluster

Ishmael — Tue, 14 Nov 2023 08:40:01 GMT

Kaniz do you mean using this python library in scala? I did a quick google search and it seems this is possible. Is this what you mean? It seems ScalaPy is a library that allows this. Is this the library that you recommend? Thanks again.

Re: Connect to databricks from external non-spark cluster

Ishmael — Tue, 14 Nov 2023 08:53:05 GMT

Thank you very much @Retired_mod . I'll try this out.