โ06-09-2021 03:12 PM
I'm trying to use the native execution engine, Photon. How can I tell if a query is using Photon or is falling back to the non-native Spark engine?
โ06-23-2021 12:28 AM
If you are using Photon on Databricks SQL
โ01-19-2023 05:39 PM
โ01-21-2023 06:36 AM
Can you explain what's "clean the plan of your task"? Thanks.
โ01-21-2023 05:05 PM
Typo error in my second point of the previous post. Click the execution plan of your task[this is available under SQL/Dataframe tab in Spark UI]. It explains what operations run in the photon engine and what didn't execute by photon.
Passionate about hosting events and connecting people? Help us grow a vibrant local communityโsign up today to get started!
Sign Up Now