Databricks Vs Yarn - Resource Utilization

brickster_2018
Databricks Employee
Databricks Employee

I have a spark-submit application that worked fine with 8GB executor memory in yarn. I am testing the same job against the Databricks cluster with the same executor memory. However, the jobs are running slower in Databricks.