Hello @ARUN VIJAYRAGHAVAN​  really apologize for the late response. Could you add  spark.driver.extraJavaOptions verbose:class to your local spark distributed setup? So that we will have the same logs as you posted before for Databricks cluster. I need to do a comparison between local spark distributed setup and databricks cluster.