cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Lakehouse Federation

pwtnew32
New Contributor III

I use Lakehouse Federation to connect hive metastore (local VM) with metastore database type mysql

It's can see database and table in hive but when I query data session continue running without failed or success.

Do I have to migrate data to ADLs which mount with external location for catalog ?

1 ACCEPTED SOLUTION

Accepted Solutions

Avinash_Narala
Valued Contributor II

As for Lakehouse Federation, only some sources are supported as of now. In that, connecting to HiveMetastore data which is in local VM is not supported, so you can migrate that data to ADLS and mount that as external location in unity catalog and query data from there.

View solution in original post

3 REPLIES 3

Avinash_Narala
Valued Contributor II

As for Lakehouse Federation, only some sources are supported as of now. In that, connecting to HiveMetastore data which is in local VM is not supported, so you can migrate that data to ADLS and mount that as external location in unity catalog and query data from there.

Thank you Avinash.
So in future, Will Lakehouse Federation support connection to hive metastore to query data on hive table in local ?

Avinash_Narala
Valued Contributor II

Maybe, but instead of focusing on connecting to local VM's I think Databricks will focus on broader audience, but  will get to know once they announces more supported sources.

If my answer helps you, please accept it as solution.

 

Regards,

Avinash N

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now