Python versions - Notebooks and DBR

Terje — Mon, 14 Apr 2025 13:12:19 GMT

Hi,

I have a problem with conflicting python versions in a notebook running with the Databricks 14 day free trial. One example:

spark.conf.get("spark.databricks.clusterUsageTags.clusterName") # Returns: "Python versions in the Spark Connect client and server are different. "

From the notebook i get:

import sys print("Python version:", sys.version) # Python version: 3.11.10 (main, Sep 7 2024, 18:35:41) [GCC 11.4.0]

When checking the Databricks Runtime (DBR) I get:

spark.sql('select current_version()').show(truncate=False) # Return: +-------------------------------------------------------------------------------------------------------------------+ |current_version() | +-------------------------------------------------------------------------------------------------------------------+ |{16.2.x-photon-scala2.12, NULL, 25febc4dda008cee33c7cc2917b4fcf1751d09cc, 71560b5c13fbd79930e69ec9f2863ca7018b22fe}| +-------------------------------------------------------------------------------------------------------------------+

This post (https://community.databricks.com/t5/community-platform-discussions/what-version-of-python-is-used-for-the-16-1-runtime/td-p/103350) Describes python version 3.12.3 for DBR version 16.X. How can I update the notebook python version to the DBR python version?

Re: Python versions - Notebooks and DBR

Renu_ — Mon, 21 Apr 2025 13:14:20 GMT

Hi @Terje, were you able to fix it? From what I know, during the free trial period we’re limited to the default setup, so version mismatches can’t be resolved unless we upgrade to a paid workspace.

topic Re: Python versions - Notebooks and DBR in Get Started Discussions

Python versions - Notebooks and DBR

Re: Python versions - Notebooks and DBR