Resolved! Unable to run 2 different applications with the same class name on a cluster
I have two jars with the same class name. It works fine on yarn. When trying to run these jars on the Databricks cluster, I run into issues. Why Databricks is having this limitation?
- 1581 Views
- 1 replies
- 0 kudos
Latest Reply
When you run the jobs in Yarn, those are 2 different applications getting submitted on Yarn. Hence each application will have a separate Spark driver JVM's. In Databricks, a cluster has one JVM for the Spark driver. When applications with the same na...
- 0 kudos