Hi,
In Databricks, external tables are linked to an existing object store in Unity Catalog by registering their metadata, enabling SQL queries on the data. However, Databricks doesn't automatically track changes or updates made in the external storage location specified for these tables. Therefore, if there are any additions or modifications to the files in the external storage, it's necessary to manually refresh the external table's metadata within Unity Catalog. This is done by executing the MSCK REPAIR TABLE command, which helps in incorporating the new or updated partitions or files into the table..
Refer to the below documentation for more information:
https://docs.databricks.com/en/data-governance/unity-catalog/create-tables.html#create-a-table-from-...
Harshit Kesharwani
Data engineer at Rsystema