cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

unity catalog external migration and downtime

karthik_p
Esteemed Contributor

HI Team,

once after implementing unity catalog and start migrating external tables from legacy hive to unity catalog, i am seeing in articles that we need to make changes to our workloads to be in sync with 3 level name space

eg: if i have 50 notebooks which uses legacy hive, usually there is no 3-level name space and we can run our notebooks based on standard spark queries. but after migrating to unity catalog if i need to run those notebooks and i am not using default hive_metastore config in spark level, do i need to manually change to use catalog and followed by schema.tablename in spark/python codes in notebooks to work without any issues

Note: i have seen article where we can use both legacy and unity catalog until we feel confident on functionalities are in tack with our requirement and drop legacy tables. if we drop legacy, do we need to change all notebooks to use catalog and 3 level namespaces

do we have backup mechanism in case if we want to revert back to legacy. is that INFORMATION_SCHEMA backup or any other mechanisam

3 REPLIES 3

Aviral-Bhardwaj
Esteemed Contributor III

you can check with the databricks team on this send email to help@databricks.com they will help you

karthik_p
Esteemed Contributor

@Aviral Bhardwaj​ this will be normal priority and it takes lot of time to get response.

team, we are looking for downtime possibilities and how to handle or change workflows or notebooks to use unity catalog 3 level namespace. do we have any utility to directly run, and it takes care to modify globally all over notebooks

eg: if i have 15 notebooks and i have multiple databases, do i need to change manually in notebooks to use unity catalog and databases in that with 3 level namespace and also if i have few jobs which uses external mount points, do i need to specify or modify to use unity catalog or once after migrating external tables to UC does it automatically takes care @pat​ any suggestions please

Aviral-Bhardwaj
Esteemed Contributor III

yes right maybe @Kaniz Fatma​  can help you here

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!