cancel
Showing results for 
Search instead for 
Did you mean: 
Community Articles
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

aayush_410
by • New Contributor II
  • 119 Views
  • 1 replies
  • 1 kudos

Spark Internals on Databricks

Every Spark engineer eventually hits the same wall: the query works, but you don't know why it's slow, or why it suddenly got fast after a one-line config change. The gap between "I can write Spark SQL" and "I can reason about Spark's execution" is a...

  • 119 Views
  • 1 replies
  • 1 kudos
Latest Reply
ivanvyd
New Contributor III
  • 1 kudos

Thanks for sharing this, @aayush_410 - really useful breakdown and important topic.One small nuance that might be worth mentioning around "EXPLAIN FORMATTED": with AQE, SQL "EXPLAIN" doesn't execute the query, so it only shows the initial plan rather...

  • 1 kudos
Labels