topic Re: Access table outside Databricks (hive metastore) in Data Governance

Access table outside Databricks (hive metastore)

William_Scardua — Wed, 15 Dec 2021 15:07:53 GMT

Hi guys, how are you ?

How can I access tables outside the Databricks ? (hive metastore)

I have a python script in my local structure but I need to access are tables stored in Databricks (hive metastore) , how ???? Have any idea ?

Thank you guys

Hubert-Dudek — Wed, 15 Dec 2021 15:20:10 GMT

You can use jdbc/odbc drivers https://docs.databricks.com/integrations/bi/jdbc-odbc-bi.html disadvantage is that in normal version general computing cluster have run.

In public preview there is serverless SQL endpoint - you need to ask databricks for enabling it.

Also when you store your table on storage mounts (Azure blob, s3, ADLS) from many tools (PowerBI, Sata Factory) you can load it as a dataset.

-werners- — Thu, 16 Dec 2021 08:17:12 GMT

using odbc as Hubert mentioned is the easiest way.

Besides Databricks and Databricks SQL, there are also other options like Azure Synapse Serverless, Presto etc.

They all serve data as tables.

Python also has a parquet reader using pyarrow f.e.

William_Scardua — Thu, 16 Dec 2021 11:51:54 GMT

@Hubert Dudek the serveless SQL endpoint it seems to me a good choice

William_Scardua — Thu, 16 Dec 2021 11:52:17 GMT

thank you @Werner Stinckens

pokharatours — Wed, 16 Aug 2023 17:00:08 GMT