I'm not sure we can migrate to 17 before it reaches LTS status, and there's also Spark 4.0 to migrate to. So I'd like to just use Scala 2.13 on 16.4 for now. It seems that getting rid of Databricks Connect solves my dependency issues and also issues with Databricks overrides of Spark and Delta APIs.