topic Re: Columns tab in Data Explorer doesn't reflect schema changes to table in Data Engineering

Columns tab in Data Explorer doesn't reflect schema changes to table

rahulmadnawat — Thu, 20 Jul 2023 22:48:11 GMT

Hey team, we've noticed that schema changes to a table after creation aren't reflected in the "Columns" tab in the Data Explorer. For example, we added a column called signal_description to a table but its addition isn't reflected in the UI. Is this a known issue? If we run DESCRIBE TABLE on the table the column appears though.

Re: Columns tab in Data Explorer doesn't reflect schema changes to table

Tharun-Kumar — Fri, 21 Jul 2023 04:52:58 GMT

@rahulmadnawat

Is this a Unity Catalog enabled table?

If so, could try running - REPAIR [unity.table] SYNC METADATA

This should refresh the schema on the UC metadata.

Re: Columns tab in Data Explorer doesn't reflect schema changes to table

rahulmadnawat — Fri, 21 Jul 2023 05:07:29 GMT

Yup that worked, thanks @Tharun-Kumar!

Re: Columns tab in Data Explorer doesn't reflect schema changes to table

claudius_hini — Fri, 12 Jan 2024 09:26:51 GMT

@Tharun-Kumar
Is this behavior the default behavior in case a schema change happens on a table registered in unity catalog?
In that case I would have to run the repair command regularly in order to ensure that the schema displayed is actually the one of the delta table?