ranged_coop
Valued Contributor II

Hi @Vidula Khanna​ , thank you for your response. I had also responded to a similar message from @Kaniz Fatma​ . Anyways the issue is still not resolved.

The issue is still not resolved.

I was hoping someone from Databricks would be able to help. Please help if possible.

Steps to Reproduce:

  1. Have two folders in Workspace - init_scripts and jars.
  2. Have any jar file in the jars folder.
  3. Have an init script in the init_scripts folder that copies the jar file from the jars folder into the /databricks/databricks-hive/ folder in the cluster.

```bash

#!/bin/bash

cp /Workspace/jars/file_name.jar /databricks/jars/

cp /Workspace/jars/file_name.jar /databricks/databricks-hive/

```

  1. Configure the init script in the workspace in the Cluster configuration.

Expected:

  1. Cluster needs to start without any error.
  2. The jar has to be copied to the /databricks/databricks-hive/ folder.

Current Behaviour:

  1. The cluster is not starting.
  2. Init script is failing stating that the source file is not available.

Things already tried:

  1. Have tried file path with and without /Workspace - both are failing saying file is not available.
  2. I have also tried sleep for up to 2 minutes and the files are still not available.
  3. Have tried an init script that would just list the files in the path and print to a file. Even listing fails stating file/path is not available.