Anonymous
Not applicable

I'm not on infra team, but it seems that

 spark.databricks.pyspark.enablePy4JSecurity false

did the job