07-03-2025 06:19 AM
I recommend checking the Spark UI to identify where the bottleneck is, or, if you are using Databricks SQL, reviewing the query analyzer.
Lou
