https://community.databricks.com/t5/data-engineering/photon-benchmark/m-p/89719#M37892 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/109759">@Enrique1987</a>&nbsp;,</P><P>You can find more information about photon in below whitepaper:</P><P><A href="https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf" target="_blank">https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf</A></P> Fri, 13 Sep 2024 07:55:17 GMT szymon_dybczak 2024-09-13T07:55:17Z https://community.databricks.com/t5/data-engineering/photon-benchmark/m-p/89715#M37891 <P>I'm conducting my own comparative study between a cluster with Photon enabled and a cluster without Photon to see what improvements occur. According to Databricks, there should be up to 12x better performance, but I'm only finding about a 20% improvement. Does anyone know more about which operations Photon might be interesting for or in what scenarios it excels? Or does anyone know more about the benchmark Databricks conducted in this case?<BR />BR, Enrique</P> Fri, 13 Sep 2024 07:05:36 GMT https://community.databricks.com/t5/data-engineering/photon-benchmark/m-p/89715#M37891 Enrique1987 2024-09-13T07:05:36Z https://community.databricks.com/t5/data-engineering/photon-benchmark/m-p/89719#M37892 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/109759">@Enrique1987</a>&nbsp;,</P><P>You can find more information about photon in below whitepaper:</P><P><A href="https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf" target="_blank">https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf</A></P> Fri, 13 Sep 2024 07:55:17 GMT https://community.databricks.com/t5/data-engineering/photon-benchmark/m-p/89719#M37892 szymon_dybczak 2024-09-13T07:55:17Z