When using mlflow.spark.log_model() I get a "failed to save spark model via mlflowdbfs" error.

Adam_Pavlacka — Thu, 11 Jan 2024 01:00:00 GMT

The trace indicates a statusCode=401 error caused by com.databricks.mlflowdbfs.MlflowHttpException.

You need to disable mlflowdbfs in the environment variable before executing log_model().

Example code:

import os
os.environ["DISABLE_MLFLOWDBFS"] = "True"

article When using mlflow.spark.log_model() I get a "failed to save spark model via mlflowdbfs" error. in Support FAQs