Databricks Community

mslow · 05-28-2025

I'm trying to test a custom python package with new 16.4 LTS runtime, pulling the official Databricks docker image fromhttps://hub.docker.com/layers/databricksruntime/standard/16.4-LTS/images/sha256-604b73feeac08bc902ab16110218ffc63c1b24ac31f5f04a679...

mslow · 05-29-2025

Thanks @Renu_ . That makes sense, I understand that in the DBX workspaces, you can choose between two 16.4 spark versions when creating a compute.My confusion was with using the docker image in local environment. I pull it from the registry but then ...

mslow · 12-18-2024

I think in case you're deliberately installing databricks-connect, then you need to handle the local spark session creation.My issue is that I'm using databricks-dlt package which installs databricks-connect as a dependency. In the latest package ver...

Databricks Community

User Stats

User Activity

Docker image for runtime 16.4 LTS with Scala 2.13

Re: Docker image for runtime 16.4 LTS with Scala 2.13

Re: Installing Databricks Connect breaks pyspark local cluster mode