11-18-2022 07:06 AM
Hi all,
I have set up a Unity Catalog (UC), and I am attempting to "upgrade my Delta tables" in the hive_metastore to my new catalog.
I have followed the instructions here: https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/migrate
I have set up a Access Connector and configured external locations in the UC.
I am getting the following error when using the "Upgrade Wizard" - any ideas how to resolve this issue?
As I understand it, when I click "Run the upgrade" the wizard runs this SQL query
-- Note: removed the names of the databases and tables for privacy
-- Upgrade hive_metastore.db.tblto cat.db.tbl
CREATE TABLE cat.db.tbl LIKE hive_metastore.db.tbl COPY LOCATION;
ALTER TABLE hive_metastore.db.tbl SET TBLPROPERTIES ('upgraded_to' = 'cat.db.tbl');
From this post on Stack Overflow it would seem that delta tables are not supported with the LIKE sql command.
11-18-2022 11:15 AM
FYI - this is now magically resolved. I'm guessing it was a temporary bug or something.
11-18-2022 07:54 AM
11-18-2022 03:21 PM
@James Winfield it should be 3 level namespaces, catalog name cannot be hive_metastore
eg:CREATE TABLE <catalog_name>.<schema_name>.<table_name>
11-18-2022 11:15 AM
FYI - this is now magically resolved. I'm guessing it was a temporary bug or something.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.