Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-27-2022 04:36 PM
@Uma Maheswara Rao Desula your documentation states the following criteria for DFP to be used:
- The inner table (probe side) being joined is in Delta Lake format
- The join type is INNER or LEFT-SEMI
- The join strategy is BROADCAST HASH JOIN
- The number of files in the inner table is greater than the value for spark.databricks.optimizer.deltaTableFilesThreshold
In my case, the query does not even have any joins.
Anyway I tried switching off the parameter you gave and it did not make any difference.