topic Re: Unity Catalog "Sync" Question in Data Engineering

Unity Catalog "Sync" Question

Kayla — Wed, 05 Mar 2025 19:38:51 GMT

I'm having a little trouble fully following the documentation on the SYNC command.

I have a table in hive_metastore that still needs to be able to be updated daily for the next few months, but I also need to define a view in Unity Catalog based on that table.

Will running sync table catalog.schema.table FROM hive_metastore.schema.table allow me to keep updating the hive_metastore table using a non UC cluster, and keep the UC table in sync?

Re: Unity Catalog "Sync" Question

seohunter106 — Wed, 05 Mar 2025 20:03:18 GMT

😊

Re: Unity Catalog "Sync" Question

Nivethan_Venkat — Wed, 05 Mar 2025 23:25:15 GMT

Hi @Kayla,

SYNC command is to sync your hive EXTERNAL table to your Unity Catalog name space. If the table is external, the UC table will be in sync with your external location. If it is hive managed table, you can't use SYNC command to have your managed table in UC metastore. For more details on table compatibility and SYNC, please refer the following documentation: https://docs.databricks.com/aws/en/sql/language-manual/sql-ref-syntax-aux-sync

Re: Unity Catalog "Sync" Question

Kayla — Fri, 07 Mar 2025 13:08:20 GMT

Ah, I did in fact miss the part where it won't work with hive managed tables. Guess I'll need to look for another solution- thanks!

Re: Unity Catalog "Sync" Question

seohunter106 — Mon, 10 Mar 2025 17:57:38 GMT

😊