cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Error in migration with UCX tool

priyansh
New Contributor III

Hey folks!

I am facing an issue while migration the tables from Hive to UC using UCX tool; after completely running the setup and getting the assessment overview, we ran the following commands i.e.  "databricks labs ucx create-table-mapping" but after we ran the command "databricks labs ucx migrate-tables", it should be supposed to migrate the tables those which are in my dbfs and already in the parquet format. As after successfully running the command, I am not getting any error but the database that has been created in the UC, the following tables are not reflecting there in the UC. I also ran the SYNC command for the external tables too, but the issue is same in that case also

I would also like to know that in the assessment overview what does the UC readiness signifies?
For your reference I am attaching the screenshots, please refer to them...
Thanks,

6 REPLIES 6

gchandra
Databricks Employee
Databricks Employee

After running this command databricks labs ucx create-table-mapping, you should see a text file with a list of tables. I hope you updated the respective Catalog names before running the migrate-tables command.

90% of the total objects can be readily migrated to UC.



~

priyansh
New Contributor III

@gchandra Yes we have updated the respective Catalog names accordingly but unfortunately the tables are not reflecting there in the UC Catalog
Can you also send me the proper steps, In case We are missing any of them.

priyansh
New Contributor III

@gchandra for your reference,image (17).png

BasheerAhmed
New Contributor II

Hi @priyansh ,

If your workflow run successfull without any error, you can check the logs why to find why your table is not migrated from hive metastore to UC

BasheerAhmed_0-1727163384779.png

In above img you can see a log folder where you can see all your workflow logs, 

and one query is can you able to create table in your catalog?? if not that will be an issue

Hii @BasheerAhmed ,
data bricks labs UCX create-catalogs-schemas
After running the above command, we were able to create the catalog and schemas,

But unfortunately, after running this command data bricks labs UCX migrate-tables, Tables are not reflecting in UC and on verifying the log files the error we found was 429 too many requests.
"Changes have been made in the commands to post "

image (16).pngimage (15).png

 

gchandra
Databricks Employee
Databricks Employee

Please open an issue with the UCX team.

https://github.com/databrickslabs/ucx/issues



~

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group