https://community.databricks.com/t5/data-engineering/spark-failure-error-unable-to-download-spark-docker-image/m-p/19511#M13088 <P>Cluster terminated.&nbsp;Reason:&nbsp;Spark Image Download Failure</P><P></P><P></P><P>&nbsp;&nbsp;"reason": { "code": "SPARK_IMAGE_DOWNLOAD_FAILURE", "type": "SERVICE_FAULT", "parameters": { "instance_id": "6565aa39b0ae4fe69c7fe6f313e3ca2a", "databricks_error_message": "Failed to set up the docker container due to a spark image download failure: Failed to download Spark image release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2 with exit code 1, stdout = , stderr = 2022/05/25 12:34:21 INFO worker_common.py:443: Acquiring lock file: /var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock\nTraceback (most recent call last):\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 339, in execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 267, in _wrap_coverage\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 299, in _wrap_profiling\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 382, in _execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 440, in execute_entry\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 445, in execute_module\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 308, in run_module_with_sys_modules_override\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 90, in _run_code\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 217, in &lt;module&gt;\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 208, in main\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_spark.py\", line 168, in handle_spark\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_common.py\", line 444, in acquire_lock_file\nIOError: [Errno 30] Read-only file system: '/var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock'\n" } } }</P><P></P> Thu, 26 May 2022 12:16:39 GMT Soma 2022-05-26T12:16:39Z https://community.databricks.com/t5/data-engineering/spark-failure-error-unable-to-download-spark-docker-image/m-p/19511#M13088 <P>Cluster terminated.&nbsp;Reason:&nbsp;Spark Image Download Failure</P><P></P><P></P><P>&nbsp;&nbsp;"reason": { "code": "SPARK_IMAGE_DOWNLOAD_FAILURE", "type": "SERVICE_FAULT", "parameters": { "instance_id": "6565aa39b0ae4fe69c7fe6f313e3ca2a", "databricks_error_message": "Failed to set up the docker container due to a spark image download failure: Failed to download Spark image release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2 with exit code 1, stdout = , stderr = 2022/05/25 12:34:21 INFO worker_common.py:443: Acquiring lock file: /var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock\nTraceback (most recent call last):\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 339, in execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 267, in _wrap_coverage\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 299, in _wrap_profiling\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 382, in _execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 440, in execute_entry\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 445, in execute_module\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 308, in run_module_with_sys_modules_override\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 90, in _run_code\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 217, in &lt;module&gt;\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 208, in main\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_spark.py\", line 168, in handle_spark\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_common.py\", line 444, in acquire_lock_file\nIOError: [Errno 30] Read-only file system: '/var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock'\n" } } }</P><P></P> Thu, 26 May 2022 12:16:39 GMT https://community.databricks.com/t5/data-engineering/spark-failure-error-unable-to-download-spark-docker-image/m-p/19511#M13088 Soma 2022-05-26T12:16:39Z