cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

unity catalog external migration and downtime

karthik_p
Esteemed Contributor

HI Team,

once after implementing unity catalog and start migrating external tables from legacy hive to unity catalog, i am seeing in articles that we need to make changes to our workloads to be in sync with 3 level name space

eg: if i have 50 notebooks which uses legacy hive, usually there is no 3-level name space and we can run our notebooks based on standard spark queries. but after migrating to unity catalog if i need to run those notebooks and i am not using default hive_metastore config in spark level, do i need to manually change to use catalog and followed by schema.tablename in spark/python codes in notebooks to work without any issues

Note: i have seen article where we can use both legacy and unity catalog until we feel confident on functionalities are in tack with our requirement and drop legacy tables. if we drop legacy, do we need to change all notebooks to use catalog and 3 level namespaces

do we have backup mechanism in case if we want to revert back to legacy. is that INFORMATION_SCHEMA backup or any other mechanisam

3 REPLIES 3

Aviral-Bhardwaj
Esteemed Contributor III

you can check with the databricks team on this send email to help@databricks.com they will help you

AviralBhardwaj

karthik_p
Esteemed Contributor

@Aviral Bhardwaj​ this will be normal priority and it takes lot of time to get response.

team, we are looking for downtime possibilities and how to handle or change workflows or notebooks to use unity catalog 3 level namespace. do we have any utility to directly run, and it takes care to modify globally all over notebooks

eg: if i have 15 notebooks and i have multiple databases, do i need to change manually in notebooks to use unity catalog and databases in that with 3 level namespace and also if i have few jobs which uses external mount points, do i need to specify or modify to use unity catalog or once after migrating external tables to UC does it automatically takes care @pat​ any suggestions please

Aviral-Bhardwaj
Esteemed Contributor III

yes right maybe @Kaniz Fatma​  can help you here

AviralBhardwaj

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group