Spark UI SQL/Dataframe tab missing queries
Hi,Recently, I am having some problems viewing the query plans in the Spark UI SQL/Dataframe tab.I would expect to see large query plans in the SQL tab where we can observe the details of the query such as the rows read/written/shuffled. However, I s...
- 4728 Views
- 1 replies
- 0 kudos
Latest Reply
@Koray Beyaz​ :This issue may be related to a change in the default behavior of the Spark UI in recent versions of Databricks Runtime. In earlier versions, the Spark UI would display the full query plan for SQL and DataFrame operations in the SQL/Dat...
- 0 kudos