I'm using the Redshift data source to load data into spark SQL data frames. However, I'm not seeing predicate push down for my queries ran on Redshift - is that expected?

sajith_appukutt
Databricks Employee
Databricks Employee

‎06-09-2021 01:28 AM

I was expecting filter operations to be pushed down to Redshift by the optimizer. However, the entire dataset is getting loaded from Redshift.

Labels:
0 Kudos