topic How Delta Lake parses through the files on querying the table with a filter condition in Data Engineering https://community.databricks.com/t5/data-engineering/how-delta-lake-parses-through-the-files-on-querying-the-table/m-p/25491#M17731 <P>Consider a table that gets partitioned on a date field. But, I'm filtering a column that is not partitioned. Now, with this filter condition whether all the files are parsed to attain the required result set, or does any data skipping happens?</P> Thu, 27 Oct 2022 14:23:14 GMT Raghav1 2022-10-27T14:23:14Z How Delta Lake parses through the files on querying the table with a filter condition https://community.databricks.com/t5/data-engineering/how-delta-lake-parses-through-the-files-on-querying-the-table/m-p/25491#M17731 <P>Consider a table that gets partitioned on a date field. But, I'm filtering a column that is not partitioned. Now, with this filter condition whether all the files are parsed to attain the required result set, or does any data skipping happens?</P> Thu, 27 Oct 2022 14:23:14 GMT https://community.databricks.com/t5/data-engineering/how-delta-lake-parses-through-the-files-on-querying-the-table/m-p/25491#M17731 Raghav1 2022-10-27T14:23:14Z