Is there a way to know if Adaptive Query Execution with Spark 3 has changed my Spark plan?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-08-2021 03:27 PM
From the demo notebook located here (https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html) it seems like the approach to demonstrate AQE was working was to first calculate the Spark query plan before running, and then review the Spark UI afterwards to determine if these plans match. Are there other ways that I can get this information?
Labels:
0 REPLIES 0

