cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

When adding new columns with overwriteSchema = True it does not add it to UC

ossinova
Contributor II

I have discovered some strange behavior when adding new columns to a table associated with Unity Catalog. I overwrote the data specifying overwriteSchema = True and passing in the abfss path as it is an external table.

When quering against it, it is discovered, however when I use information_schema and data explorer it is not listed.

Screenshot 2022-10-14 120710 

Does it have something to do with it still being associated to the old hive_metastore? I am having a hard time to figure it out and any help is appreciated.

2 REPLIES 2

Hubert-Dudek
Esteemed Contributor III

I bet that issue is that you update it as an external table. So as it is not managed table, then infromation_schema is not updated.

Anonymous
Not applicable

Hi @Oscar Dyremyhr​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group