Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-25-2023 12:00 AM
To find the hive.metastore.uri needed for the delta.properties file, you can follow the below steps:
- Login to your AWS Glue console
- Click on the "Crawlers" tab and select the Glue crawler that you are using for your Delta tables
- In the "Crawler details" section, scroll down to "Data stores" and find the "JDBC URL" field
- Copy the value of the "JDBC URL" field and paste it into the hive.metastore.uri field in your delta.properties file
Alternatively, you can also find the hive.metastore.uri in Databricks by following these steps:
- Open a Databricks notebook
- Run the command spark.conf.get("spark.sql.catalogImplementation") to check which catalog implementation is being used. It should return either "hive" or "in-memory"
- If the catalog implementation is "hive", run the command spark.conf.get("hive.metastore.uris") to get the hive.metastore.uri
- If the catalog implementation is "in-memory", run the command spark.conf.get("spark.sql.warehouse.dir") to get the hive.metastore.uri which will be in the format dbc:derby:;databaseName=<path-to-warehouse-directory>/metastore_db;create=true
Once you have the hive.metastore.uri, you can use it in the delta.properties file to query Delta tables using Presto.
Hope this helps!