Databricks Community

lukas_vlk · 03-28-2022

Hi databricks experts. I am currently facing a problem with a submitted job run on Azure Databricks. Any help on this is very welcome. See below for details:Problem Description:I submitted a python spark task via the databricks cli (v0.16.4) to Azure...

lukas_vlk · 03-30-2022

Without any further changes from my side, the error has disappeard since 29.03.2022

lukas_vlk · 03-28-2022

Thanks for the answer  After writing the question, I tested using "spark.databricks.driver.disableScalaOutput": "true". Unfortunately this did not help with solving the problem. Regarding "collect()" we are running the job with 0 executers, as we a...

Databricks Community

User Stats

User Activity

Python Spark Job - error: job failed with error message The output of the notebook is too large.

Re: Python Spark Job - error: job failed with error message The output of the notebook is too large.

Re: Python Spark Job - error: job failed with error message The output of the notebook is too large.