Predicate pushdown query
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-17-2025 08:03 PM
Does predicate pushdown works when we provide a filter on a dataframe reading a delta table with 2 lakh values
i.e
filter condition:column is in(list)
list contains 2lakh elements
i need to get n number of columns from a table
i am currently using join here
2lakh records join 1 billion records
thinking if i add the filter before join on the 1 billion table will it give performance improvement?