cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Spark Failure Error Unable to download spark docker Image

Soma
Valued Contributor

Cluster terminated. Reason: Spark Image Download Failure

  "reason": { "code": "SPARK_IMAGE_DOWNLOAD_FAILURE", "type": "SERVICE_FAULT", "parameters": { "instance_id": "6565aa39b0ae4fe69c7fe6f313e3ca2a", "databricks_error_message": "Failed to set up the docker container due to a spark image download failure: Failed to download Spark image release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2 with exit code 1, stdout = , stderr = 2022/05/25 12:34:21 INFO worker_common.py:443: Acquiring lock file: /var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock\nTraceback (most recent call last):\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 339, in execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 267, in _wrap_coverage\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 299, in _wrap_profiling\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 382, in _execute\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 440, in execute_entry\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/pex.py\", line 445, in execute_module\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 308, in run_module_with_sys_modules_override\n File \"/home/ubuntu/databricks/scripts/update_worker/.bootstrap/_pex/hacked_runpy.py\", line 90, in _run_code\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 217, in <module>\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/update_worker.py\", line 208, in main\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_spark.py\", line 168, in handle_spark\n File \"/home/ubuntu/databricks/scripts/update_worker/manager/scripts/worker_common.py\", line 444, in acquire_lock_file\nIOError: [Errno 30] Read-only file system: '/var/lib/lxc/base-images/release__9.1.x-snapshot-scala2.12__databricks-universe__head__ea1927f__22a25a8__jenkins__26c6769__format-2.lock'\n" } } }

0 REPLIES 0

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now