Hello!

I have a GPU compute using my own custom docker container. I am trying to upgrade from python 3.10 to 3.12 since 3.10 EOL is next year, but I cannot find any official documentation around this for Databricks runtime.

My current working solution uses databricksruntime/gpu-base:cuda11.8 (based on this official example: https://github.com/databricks/containers/blob/master/ubuntu/gpu/cuda-11.8/venv/Dockerfile) which supports python 3.10, but unfortunately it does not natively support python 3.12. I installed python 3.12 from source still using databricksruntime/gpu-base:cuda11.8, but can't seem to get it to work when running in Databricks with runtime 16.4 LTS and g4dn.xlarge [T4]. 

Has anyone come up with workaround or an alternative solution to this?