cgrant
Databricks Employee
Databricks Employee

I don't have full access to that article, but here's something that might help clarify things!

While Spark uses lazy evaluation (meaning it waits to execute until absolutely necessary), Python works with eager evaluation. This means that when you run log_step, the Python code jumps into action and executes right away