I'm trying to create a spark udf for a registered model and getting:
Exception: Python versions in the Spark Connect client and server are different. To execute user-defined functions, client and server should have the same minor Python version. Please update the Python version in the client. You can check the current Python version on the server by running `spark.sql('select current_version()').show()` or by consulting Databricks release notes. Release notes for cluster compute can be found at https://docs.databricks.com/en/release-notes/runtime/index.html and release notes for serverless can be found at https://docs.databricks.com/en/release-notes/serverless.html.
But
>>> spark.sql('select current_version()').show(truncate=False)
+-------------------------------------------------------------------------------------------------------------------+
|current_version() |
+-------------------------------------------------------------------------------------------------------------------+
|{16.1.x-photon-scala2.12, NULL, bb77706b447f7a5eb0b80ed951276c31f44da631, b3638694ebd6dce2d742ae94b812e7b0302df1d0}|
+-------------------------------------------------------------------------------------------------------------------+
And the 16.x release notes don't say what Python version is used.
