topic Re: When will databricks runtime be released for Scala 2.13? in Data Engineering

When will databricks runtime be released for Scala 2.13?

qwerty1 — Thu, 23 Mar 2023 12:46:15 GMT

I see that spark fully supports Scala 2.13. I wonder why is there no databricks runtime with Scala 2.13 yet. Any plans on making this available? It would be super useful.

Re: When will databricks runtime be released for Scala 2.13?

Anonymous — Thu, 23 Mar 2023 13:26:01 GMT

From my reading, it looks like engineering is going to target the DBR 14 release for Scala 2.13. It looks like azure events hub isn't compatible with 2.13 and that's going to cause some issues as we don't maintain that library at all. It's currently being worked on, but takes a little while.

Re: When will databricks runtime be released for Scala 2.13?

qwerty1 — Thu, 23 Mar 2023 14:14:22 GMT

Thanks for the response. Is there a tentative date for DBR 14 release?

Re: When will databricks runtime be released for Scala 2.13?

Anonymous — Thu, 23 Mar 2023 17:32:57 GMT

There isn't a date for DBR13. There is usually a DBR version every 6 months, so maybe look at it in late 2023.

Re: When will databricks runtime be released for Scala 2.13?

source2sea — Sat, 10 Feb 2024 19:10:14 GMT

I see db runtime 14 is out, but still 2.12, when would databricks plan to support 2.13 or 3

thank you

Re: When will databricks runtime be released for Scala 2.13?

adrian_abreu — Wed, 01 May 2024 20:46:53 GMT

Looks like its worth to open a new question. I'd like to know too

Re: When will databricks runtime be released for Scala 2.13?

777 — Wed, 07 Aug 2024 13:12:41 GMT

Currently, I can use databricks-connect only with scala 2.12. When a runtime and databricks-connect with Scala 2.13 are introduced, that would open the possibility to use Scala 3 with databricks-connect, and that would be amazing.

Re: When will databricks runtime be released for Scala 2.13?

guersam — Mon, 11 Nov 2024 09:18:29 GMT

I agree with @777. As Scala 3 is getting mature and there are more real use cases with Scala 3 on Spark now, support for Scala 2.13 will be valuable to users including us.

I think the recent upgrade of Databricks runtime from JDK 8 to 17 was one of a prerequisites to adopt Scala 2.13 and it's a good news, because many important Scala libraries dropped JDK 8 support in these days.