🚀 Boost Databricks Performance ✅ Lazy Evaluation and Spark DataFrame Caching ☕

[Coffee77]

Published new video in my recently created youtube channel about one of my favorite topics: performance.  So, here is a new video whose goal is to explain clearly what lazy evaluation is and how to use caching to boost performance.

 👉  https://studio.youtube.com/video/pLGAr1VXQSQ 

I usually see these concepts are largely misunderstood and I think they are KEY to work with databricks from the very beginning and not to incur in performance issues. So, I decided to create these series not only to my team but to share with community while it serves to myself to remember due to my very bad long-term human memory xD. 

I hope you find it useful.

And YES, doing this with a lot of coffee...

[szymon_dybczak · Accepted solution]

Thanks @Coffee77 . This is great. For me performance tuning is one of the most interesting parts when it comes to working with Spark. This is going to be an awesome series 🙂

[Coffee77]

Not sure if previous link works fine, here is the correct one ▶️ https://youtu.be/pLGAr1VXQSQ?si=QaKzaNfzrNl_0Tv9