cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Lakehouse Federation

pwtnew32
New Contributor III

I use Lakehouse Federation to connect hive metastore (local VM) with metastore database type mysql

It's can see database and table in hive but when I query data session continue running without failed or success.

Do I have to migrate data to ADLs which mount with external location for catalog ?

1 ACCEPTED SOLUTION

Accepted Solutions

Avinash_Narala
Valued Contributor II

As for Lakehouse Federation, only some sources are supported as of now. In that, connecting to HiveMetastore data which is in local VM is not supported, so you can migrate that data to ADLS and mount that as external location in unity catalog and query data from there.

View solution in original post

3 REPLIES 3

Avinash_Narala
Valued Contributor II

As for Lakehouse Federation, only some sources are supported as of now. In that, connecting to HiveMetastore data which is in local VM is not supported, so you can migrate that data to ADLS and mount that as external location in unity catalog and query data from there.

Thank you Avinash.
So in future, Will Lakehouse Federation support connection to hive metastore to query data on hive table in local ?

Avinash_Narala
Valued Contributor II

Maybe, but instead of focusing on connecting to local VM's I think Databricks will focus on broader audience, but  will get to know once they announces more supported sources.

If my answer helps you, please accept it as solution.

 

Regards,

Avinash N

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group