I ran into an unexpected error while writing a DataFrame to a managed table df.write \
.mode("append") \
.option("overwriteSchema", "true") \
.option("mergeSchema", "true") \
.saveAsTable(bsr_sink_table_fqn)Instead of appending, Spark attemp...
https://github.com/mlflow/mlflow/issues/11077 In Databricks, when attempting to set an experiment with an experiment_name specified as an absolute path from /Workspace/Shared/mlflow_experiment/<experiment_name>, the mlflow.set_experiment() function ...
Thanks @szymon_dybczak and @WiliamRosa for the reply. I will probably keep mergeSchema then. If the options are incompatible or might cause issues I wish there was a warning of sorts.
