User16764241763
Databricks Employee
Databricks Employee

You should be able to just pick the version that matches Spark and Scala from maven.

Here is a simple way to get the cluster Spark version

image