I have a question regarding combining the use of Bloom filters with Liquid Clustering to further reduce the data read during a join/merge on top of dynamic file pruning. Testing both combined worked extremely well together for point queries. However having Bloom filters on a table removed dynamic file pruning entirely and lead to the entire table being read when doing a join/merge with and without Photon.
Do Bloom filters work along side dynamic file pruning? If so, any thoughts as to what might be going wrong?
Is there a plan to support such a functionality if not? If would be amazing to have it as it reduced the amount of data read by a factor of 20.