How do I know how much of a query/job used Photon?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-09-2021 03:12 PM
I'm trying to use the native execution engine, Photon. How can I tell if a query is using Photon or is falling back to the non-native Spark engine?
- Labels:
-
Databricks SQL
-
DBSQL
-
Delta engine
-
Job
-
Query Plan
-
Spark ui
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-23-2021 12:28 AM
If you are using Photon on Databricks SQL
- Click the Query History icon on the sidebar.
- Click the line containing the query you’d like to analyze.
- On the Query Details pop-up, click Execution Details.
- Look at the Task Time in Photon metric at the bottom.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-19-2023 05:39 PM
- Tasks covered by yellow shade on DAG differentiate the operators are executed within photon engine
- Also, if you clean the plan of your task, it explains well in detail what the operations run in the photon engine and what cannot be executed within it.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2023 06:36 AM
Can you explain what's "clean the plan of your task"? Thanks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2023 05:05 PM
Typo error in my second point of the previous post. Click the execution plan of your task[this is available under SQL/Dataframe tab in Spark UI]. It explains what operations run in the photon engine and what didn't execute by photon.

