Python versions - Notebooks and DBR

[Terje]

Hi,

I have a problem with conflicting python versions in a notebook running with the Databricks 14 day free trial. One example:

spark.conf.get("spark.databricks.clusterUsageTags.clusterName")

# Returns: "Python versions in the Spark Connect client and server are different. "

From the notebook i get:

import sys
print("Python version:", sys.version) # Python version: 3.11.10 (main, Sep  7 2024, 18:35:41) [GCC 11.4.0]

When checking the Databricks Runtime (DBR) I get:

spark.sql('select current_version()').show(truncate=False)

# Return:
+-------------------------------------------------------------------------------------------------------------------+
|current_version()                                                                                                  |
+-------------------------------------------------------------------------------------------------------------------+
|{16.2.x-photon-scala2.12, NULL, 25febc4dda008cee33c7cc2917b4fcf1751d09cc, 71560b5c13fbd79930e69ec9f2863ca7018b22fe}|
+-------------------------------------------------------------------------------------------------------------------+

This post (https://community.databricks.com/t5/community-platform-discussions/what-version-of-python-is-used-fo...) Describes python version 3.12.3 for DBR version 16.X. How can I update the notebook python version to the DBR python version?

[Renu_]

Hi @Terje, were you able to fix it? From what I know, during the free trial period we’re limited to the default setup, so version mismatches can’t be resolved unless we upgrade to a paid workspace.