cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Spark Failure Error Unable to download spark docker Image

Soma
Valued Contributor

Cluster terminated. Reason: Spark Image Download Failure

  "reason": { "code": "SPARK_IMAGE_DOWNLOAD_FAILURE", "type": "SERVICE_FAULT", "parameters": { "instance_id": "6565aa39b0ae4fe69c7fe6f313e3ca2a", "databricks_error_message": "Failed to set up the docker container due to a spark image download failure: Failed to download Spark image release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2 with exit code 1, stdout = , stderr = 2022/05/25 12:34:21 INFO worker_common.py:443: Acquiring lock file: /var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock\nTraceback (most recent call last):\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 339, in execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 267, in _wrap_coverage\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 299, in _wrap_profiling\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 382, in _execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 440, in execute_entry\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 445, in execute_module\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 308, in run_module_with_sys_modules_override\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 90, in _run_code\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 217, in <module>\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 208, in main\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_spark.py\", line 168, in handle_spark\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_common.py\", line 444, in acquire_lock_file\nIOError: [Errno 30] Read-only file system: '/var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock'\n" } } }

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group