Spark UI SQL/Dataframe tab missing queries
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-11-2023
12:58 AM
- last edited on
03-21-2025
05:45 AM
by
Advika
Hi,
Recently, I am having some problems viewing the query plans in the Spark UI SQL/Dataframe tab.
I would expect to see large query plans in the SQL tab where we can observe the details of the query such as the rows read/written/shuffled. However, I see just a single query with no details. The following screenshots might be helpful to understand the issue.
Here, I was expecting to see a large query plan (I can confirm this by looking at the Jobs tab).
I am having this issue in multiple Databricks Runtimes such as DBR 9.1 LTS, DBR 10.4 LTS , and DBR 12.2.
Any help is much appreciated!
- Labels:
-
SQL