cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Warehousing & Analytics
Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Fabric one lake migration

Pilsner
Contributor III

We are trying to migrate our data from Fabric One Lake to the unity catalogue. Has anyone had experience with this before? Any pointers/ things to be aware of would be appreciated.

2 ACCEPTED SOLUTIONS

Accepted Solutions

SP_6721
Honored Contributor

Hi @Pilsner ,

To migrate from Fabric OneLake to Unity Catalog, start by copying your data into ADLS Gen2, since Unity Catalog can't directly access OneLake. You can use Azure Data Factory or other ETL tools for this transfer. Once the data is in ADLS Gen2, you can register it as tables in Unity Catalog.

View solution in original post

nayan_wylde
Honored Contributor III

There are lot of options to access data in UC in fabric either by mirroring or by creating shortcuts on the ADLS. 

But there are limited options the other way round. Currently there is no way to access the fabric objects directly from databricks. One option is to try to create external location on top of the data lake where the fabric tables reside and create delta tables in UC. The other option is to create federated queries from Databricks. You can try out this option.

https://murggu.medium.com/running-federated-queries-from-unity-catalog-on-microsoft-fabric-sql-endpo...

View solution in original post

3 REPLIES 3

SP_6721
Honored Contributor

Hi @Pilsner ,

To migrate from Fabric OneLake to Unity Catalog, start by copying your data into ADLS Gen2, since Unity Catalog can't directly access OneLake. You can use Azure Data Factory or other ETL tools for this transfer. Once the data is in ADLS Gen2, you can register it as tables in Unity Catalog.

nayan_wylde
Honored Contributor III

There are lot of options to access data in UC in fabric either by mirroring or by creating shortcuts on the ADLS. 

But there are limited options the other way round. Currently there is no way to access the fabric objects directly from databricks. One option is to try to create external location on top of the data lake where the fabric tables reside and create delta tables in UC. The other option is to create federated queries from Databricks. You can try out this option.

https://murggu.medium.com/running-federated-queries-from-unity-catalog-on-microsoft-fabric-sql-endpo...

Pilsner
Contributor III

Hello @SP_6721 and  @nayan_wylde  

Thank you both for your replies, I appreciate the pointers. I'll definitely look into your suggestions of creating an intermediate step instead of migrating directly from Fabric to databricks.