https://community.databricks.com/t5/data-engineering/collect-set-collect-list-pushdown/m-p/33875#M24785 <P>Hm so collect_set does not get translated to listagg.</P><P>Can you try the following?</P><UL><LI>use a more recent version of dbrx</LI><LI>use delta lake as spark source</LI><LI>use the latest version of the snowflake connector</LI><LI>check if pushdown to snowflake is enabled</LI></UL><P></P> Fri, 03 Dec 2021 07:29:53 GMT -werners- 2021-12-03T07:29:53Z https://community.databricks.com/t5/data-engineering/collect-set-collect-list-pushdown/m-p/33874#M24784 <P>Hello,</P><P></P><P>I've noticed that Collect_Set and Collect_List are not pushed down to the database?</P><P></P><P>Runtime DB 9.1LTS</P><P>Spark 3.1.2</P><P></P><P>Database: Snowflake</P><P></P><P>Is there any way to get a distinct set from a group by in a way that will push down the query to the database?</P><P></P> Thu, 02 Dec 2021 23:53:18 GMT https://community.databricks.com/t5/data-engineering/collect-set-collect-list-pushdown/m-p/33874#M24784 Sam 2021-12-02T23:53:18Z https://community.databricks.com/t5/data-engineering/collect-set-collect-list-pushdown/m-p/33875#M24785 <P>Hm so collect_set does not get translated to listagg.</P><P>Can you try the following?</P><UL><LI>use a more recent version of dbrx</LI><LI>use delta lake as spark source</LI><LI>use the latest version of the snowflake connector</LI><LI>check if pushdown to snowflake is enabled</LI></UL><P></P> Fri, 03 Dec 2021 07:29:53 GMT https://community.databricks.com/t5/data-engineering/collect-set-collect-list-pushdown/m-p/33875#M24785 -werners- 2021-12-03T07:29:53Z