topic When adding new columns with overwriteSchema = True it does not add it to UC in Data Governance

When adding new columns with overwriteSchema = True it does not add it to UC

ossinova — Fri, 14 Oct 2022 10:12:30 GMT

I have discovered some strange behavior when adding new columns to a table associated with Unity Catalog. I overwrote the data specifying overwriteSchema = True and passing in the abfss path as it is an external table.

When quering against it, it is discovered, however when I use information_schema and data explorer it is not listed.

Does it have something to do with it still being associated to the old hive_metastore? I am having a hard time to figure it out and any help is appreciated.

Re: When adding new columns with overwriteSchema = True it does not add it to UC

Hubert-Dudek — Thu, 20 Oct 2022 12:07:05 GMT

I bet that issue is that you update it as an external table. So as it is not managed table, then infromation_schema is not updated.

Re: When adding new columns with overwriteSchema = True it does not add it to UC

Anonymous — Sun, 27 Nov 2022 12:59:26 GMT

Hi @Oscar Dyremyhr

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!