Unmanaged Table - Newly added data directories are not reflected in the table We have created an unmanaged table with partitions on the dbfs location, using SQL. After creating the tables, via SQL we are running

[kjoth]

We have created an unmanaged table with partitions on the dbfs location, using SQL.

example:

%sql
CREATE TABLE EnterpriseDailyTrafficSummarytest(EnterpriseID String,ServiceLocationID String, ReportDate String ) USING parquet PARTITIONED BY(ReportDate) LOCATION "dbfs:/mnt/enterprisecalldatabase/reports/EnterpriseDailyTrafficSummary"

After creating the tables, via SQL we are running  REPAI to make the partitions registered in the Hive

%sql
MSCK REPAIR TABLE default.EnterpriseDailyTrafficSummarytest

After that command the queries are displaying the data on the table.

When we are adding new files, this is not reflected in the table, even if we are running REFRESH TABLE

So only when we are running MSCK REPAIR TABEL then only the newly added files are reflecting.