09-06-2023 10:19 PM
@JKR
Could you try setting the configurations below at the cluster level and retry the job?
spark.databricks.python.defaultPythonRepl pythonshellspark.databricks.pyspark.py4j.pinnedThread false
View solution in original post
