Unmanaged Table - Newly added data directories are not reflected in the table We have created an unmanaged table with partitions on the dbfs location, using SQL. After creating the tables, via SQL we are running

kjoth — Tue, 26 Apr 2022 11:20:29 GMT

We have created an unmanaged table with partitions on the dbfs location, using SQL.

example:

%sql
CREATE TABLE EnterpriseDailyTrafficSummarytest(EnterpriseID String,ServiceLocationID String, ReportDate String ) USING parquet PARTITIONED BY(ReportDate) LOCATION "dbfs:/mnt/enterprisecalldatabase/reports/EnterpriseDailyTrafficSummary"

After creating the tables, via SQL we are running REPAI to make the partitions registered in the Hive

%sql
MSCK REPAIR TABLE default.EnterpriseDailyTrafficSummarytest

After that command the queries are displaying the data on the table.

When we are adding new files, this is not reflected in the table, even if we are running REFRESH TABLE

So only when we are running MSCK REPAIR TABEL then only the newly added files are reflecting.

topic Unmanaged Table - Newly added data directories are not reflected in the table We have created an unmanaged table with partitions on the dbfs location, using SQL. After creating the tables, via SQL we are running in Data Engineering

Unmanaged Table - Newly added data directories are not reflected in the table We have created an unmanaged table with partitions on the dbfs location, using SQL. After creating the tables, via SQL we are running