topic Re: How to find Databricks runtime version of the cluster in an init script in Data Engineering

How to find Databricks runtime version of the cluster in an init script

brickster_2018 — Fri, 25 Jun 2021 22:13:30 GMT

Re: How to find Databricks runtime version of the cluster in an init script

Mooune_DBU — Fri, 25 Jun 2021 22:37:39 GMT

It's set as an environment variable called `DATABRICKS_RUNTIME_VERSION`

In your init scripts, you just need to add a line to display or save the info (see python example below):

import os
print("DATABRICKS_RUNTIME_VERSION:",os.environ.get('DATABRICKS_RUNTIME_VERSION',None))

Re: How to find Databricks runtime version of the cluster in an init script

Djayashanka — Thu, 02 Mar 2023 07:04:41 GMT

I used it databricks cluster with custom docker image. it gives that "DATABRICKS_RUNTIME_VERSION: None"

Re: How to find Databricks runtime version of the cluster in an init script

Hugh_Ku — Fri, 06 Sep 2024 14:57:58 GMT

I've also run into the same issue, customised docker image does not give DATABRICKS_RUNTIME_VERSION as env. I believe there are still many issues in how customised docker image is used in databricks cluster.

Can anyone from databricks help answer it?