topic register model - need python 3, but get only python 2 in Data Engineering

register model - need python 3, but get only python 2

marchello — Wed, 24 Nov 2021 18:59:57 GMT

Hi all,

I'm trying to register a model with python 3 support, but continue getting only python 2.

I can see that runtime 6.0 and above get python 3 by default, but I don't see a way to set neither runtime version, nor python version during model registration.

How do I proceed?

Please advise.

Re: register model - need python 3, but get only python 2

Hubert-Dudek — Wed, 24 Nov 2021 22:25:07 GMT

Can you share more details?

Re: register model - need python 3, but get only python 2

-werners- — Thu, 25 Nov 2021 08:17:01 GMT

Yes more details please:

databricks runtime, how do you know you are not using python 3, cluster settings?

Re: register model - need python 3, but get only python 2

Anonymous — Thu, 25 Nov 2021 15:09:23 GMT

You don't set the python version. Each runtime has it's own version of python associated with it.

https://docs.databricks.com/release-notes/runtime/releases.html has the details.

The python and spark versions will be captured automatically by MLflow.

Re: register model - need python 3, but get only python 2

Anonymous — Thu, 25 Nov 2021 15:10:33 GMT

Also, please ignore the spark.databricks.clusterUsageTags.clusterPythonVersion config as it's out of date and will show 2 even when the actual version is 3. x

Re: register model - need python 3, but get only python 2

marchello — Fri, 03 Dec 2021 17:13:17 GMT

Hi team, thanks for getting back to me.

Let's put this on hold for now.

I will update once it's needed again. It was solely for education purpose and right now I have quite urgent stuff to do.

Have a great day.