BR_DatabricksAI
Databricks Partner

Hello Bharathi, 

Ideally the ETL job should not generate the empty parquet files in the respective location as it's an overhead to read the empty file and it's a not best practice.

Assuming this can be easily fix in ETL job while getting the rows count before generating the empty file. 

 

BR