cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Issue while Migration from hive metastrore to ucx

ashraf1395
Contributor III
  • tables : 4 tables in the schema :databricks_log that are not being migrated error showing they are in dbfs root location and cannot be managed while they are in dbfs mount location
    Example this model_notebook _logs : 

     

     

    its location is dbfs:/mnt but in the logs of table_migration it shows this error

    I have created the external location for all these tables showing correct path. 

     similarly 3 other tables show exact same errors.

    What will be the possible reason for this

    ashraf1395_1-1733480572318.jpeg

    ashraf1395_0-1733480572316.jpeg

2 REPLIES 2

MuthuLakshmi
Databricks Employee
Databricks Employee

@ashraf1395 
To migrate managed tables stored at DBFS root to UC, you can do it through Deep Clone or Create Table As Select (CTAS). This also means that the HMS table data needs to be moved to the cloud storage location governed by UC. Please ensure the location given as the S3/ABFS path is anything that's not the metastore root storage path.

Deep clone: https://docs.databricks.com/sql/language-manual/delta-clone.html

CTAS: https://docs.databricks.com/sql/language-manual/sql-ref-syntax-ddl-create-table-using.html#related-a...

 

Got idea about locations. Though i was talking about external tables.
And how to do it in ucx correctly bcz the table migration workflow there has specific default methods for migration. Any method to add custom strategies in workflow? 
Like for dbfs root tables it has default strategy of doing deep clone with managed table. but what if i want to do deep clone where source table is managed but dst table is external. We can do it manually by adding the extenral location in the query but any way to do it in ucx?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group