cancel
Showing results forĀ 
Search instead forĀ 
Did you mean:Ā 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results forĀ 
Search instead forĀ 
Did you mean:Ā 

Issues Creating External Tables in Hive Metastore vs. Unity Catalog

jv_v
Contributor

Hi Databricks Community,

Iā€™m encountering some challenges when working with external tables in Databricks. Iā€™m using both Unity Catalog and Hive Meta store and have noticed differences in how external tables are handled.

  1. Unity Catalog: I can successfully create a Delta table using the following query, specifying an external location:

CREATE TABLE IF NOT EXISTS 'UC-catalog.schema.table'
USING DELTA
LOCATION 'Path'.

 

2.Hive Metastore: When I attempt a similar approach using the Hive Metastore, I run into problems. The table gets created, but I am unable to see the data. Here is the query I used:

CREATE TABLE IF NOT EXISTS 'hivemetastore.schema.table'
USING DELTA
LOCATION 'Path'.

Despite the table being created, the data isnā€™t visible. And facing below error

 

Questions:

  1. Can external tables be created in Hive Metastore from external locations like Azure Blob or AWS S3 buckets? If so, what is the correct approach?

  2. What could be causing the data visibility issue in Hive Metastore? Iā€™ve checked the path and permissions but am still encountering problems.

Any guidance or best practices for handling external tables in Hive Metastore would be greatly appreciated!

Thanks in advance for your help!

 

 

 

1 REPLY 1

Imalkov
New Contributor III

hi @jv_v , 

that's possible to put a path to external storage i.e.:

documentation

CREATE OR REPLACE TABLE hive_metastore.schema.table
  LOCATION 's3://depts/finance/sec_filings'

Can you share which issue do you have cause it's not clear from your question

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonā€™t want to miss the chance to attend and share knowledge.

If there isnā€™t a group near you, start one and help create a community that brings people together.

Request a New Group