topic Re: Get the thrift hive.metastore.uri for Databricks unity catalog in Data Governance

Get the thrift hive.metastore.uri for Databricks unity catalog

Akshith_Rajesh — Tue, 26 Sep 2023 11:32:21 GMT

I am trying to connect to Unity catalog meta store tables using Presto
Based on the presto documentation I need to use the below configuration to connect to delta tables in the unity catalog

https://prestodb.io/docs/current/connector/hive.html

So from where can I get the hive metastore.URI from data bricks

connector.name=hive
hive.metastore.uri=thrift://localhost:9083
hive.s3.aws-access-key=<s3-access-key>
hive.s3.aws-secret-key=<s3-secret-key>

#Databricks #UnityCatalog

Re: Get the thrift hive.metastore.uri for Databricks unity catalog

MathieuDB — Mon, 13 Jan 2025 20:25:18 GMT

Hello @Akshith_Rajesh,

In order to connect Trino to Unity Catalog HMS, please use this configuration instead:

hive.metastore.uri=https://<DATABRICKS_HOST>:443/api/2.0/unity-hms-proxy/metadata hive.metastore.http.client.bearer-token=${ENV:DATABRICKS_TOKEN} hive.metastore.http.client.additional-headers=X-Databricks-Catalog-Name:<DATABRICKS_UNITY_CATALOG_NAME> hive.metastore.http.client.authentication.type=BEARER

Re: Get the thrift hive.metastore.uri for Databricks unity catalog

n_mellal — Thu, 20 Feb 2025 10:15:12 GMT

Hi @MathieuDB ,

Thanks for the tip.
On Azure, France central, I'm getting

failed: Error listing schemas for catalog catalog_dev: Error from Unity Catalog service: FEATURE_DISABLED: HMS compatibility with Unity Catalog is currently in private preview. For more information, please contact your Databricks representative.

Does it make sense to you ?

Best regards.

Re: Get the thrift hive.metastore.uri for Databricks unity catalog

MathieuDB — Thu, 20 Feb 2025 15:37:58 GMT

Yes, this feature is still in Private Preview. Please contact your account manager and they will be able to enable this feature for you to test. You just need to share the workspace ids you want this feature enabled on.

Regards,
Mathieu

Re: Get the thrift hive.metastore.uri for Databricks unity catalog

December — Wed, 02 Apr 2025 03:40:07 GMT

Hi @MathieuDB,

Currently, I have Unity Catalog in Databricks, which includes various types of data stored on Databricks and also data stored on AWS S3. I need to connect Trino and Databricks to query this data. I have a few questions about the configuration:

To use this endpoint https://<DATABRICKS_HOST>:443/api/2.0/unity-hms-proxy/metadata, do I need to configure anything to enable it in Databricks? If so, how can I do it? Do you have any documentation on this?
hive.metastore.http.client.bearer-token=${ENV:DATABRICKS_TOKEN} - Is this bearer token my personal access token?
Besides using Unity Catalog HMS, is there any other way to connect Trino to Unity Catalog in Databricks?
In order to read data stored on S3, do I need to configure anything else on Trino?

Re: Get the thrift hive.metastore.uri for Databricks unity catalog

MathieuDB — Wed, 02 Apr 2025 13:28:52 GMT

Hello @December ,

You should contact your account team if you need more info on this feature which is not GA for the time being.

Another option would be to use Iceberg REST interface: https://medium.com/@flyws1993/oss-trino-to-read-tables-from-databricks-unity-catalog-90c203fde492

Hope it helps