Databricks runtime from docker hub image

michaelh
Databricks Partner

‎03-11-2022 03:09 AM

Hello,

are databricks runtimes from docker hub ( https://hub.docker.com/r/databricksruntime/standard ) same as actual runtimes inside Databricks? I mean when we made our own docker image from databricksruntime/standard will be there same dependencies, versions etc as in runtime inside databricks? We need to archive older runtimes in bank environment and be able to run old notebooks with exactly same runtime.

And another question about runtime’s version. If I use my docker container in cluster creation with for example runtime version 6.6 but in setup I also select different version in column Databricks runtime version what will happened? Will be column Databricks runtime version ignored?

image.pngimage

Labels:
Preview file
306 KB
Preview file
224 KB

Hubert-Dudek
Databricks MVP

‎03-11-2022 03:22 AM

just build own using in docker FROM databricksruntime/standard:10.x and than it will work correctly with any 10 non beta version (although better test before changing cluster runtime)


My blog: https://databrickster.medium.com/
0 Kudos

Atanu
Databricks Employee
Databricks Employee

‎03-21-2022 12:16 PM

use the  9.x tag for an image that will target a cluster with runtime version Databricks Runtime 9.0. This is for an example. so basically you are running a image based on the version selected.so it better match.

View solution in original post

jose_gonzalez
Databricks Employee
Databricks Employee

‎04-11-2022 02:20 PM

Hi @michael henzl​ ,

Just checking if you still need help with this or not any more? please let us know

0 Kudos