Databricks Connect and DBR 16.4 LTS @ Scala 2.13

dollyb
Contributor II

Hi there,

we're running Scala jobs on Databricks and I was eager to finally upgrade to Scala 2.13. However, Databricks Connect 16.4.x doesn't handle Scala versioning, so all dependencies are tied to Scala 2.13. It's rather tedious to exclude all 2.12 dependencies. I'm also encountering the issue that the project wants to use Scala 2.13.16 (the latest version), but DBR 16.4 runs using Scala 2.13.10.

Will there be a Scala 2.13-specific release of Databricks Connect? Or is there a different way of running my project?