Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-14-2023 12:03 AM
Hi @Vidula Khanna , thank you for your response. I had also responded to a similar message from @Kaniz Fatma . Anyways the issue is still not resolved.
The issue is still not resolved.
I was hoping someone from Databricks would be able to help. Please help if possible.
Steps to Reproduce:
- Have two folders in Workspace - init_scripts and jars.
- Have any jar file in the jars folder.
- Have an init script in the init_scripts folder that copies the jar file from the jars folder into the /databricks/databricks-hive/ folder in the cluster.
```bash
#!/bin/bash
cp /Workspace/jars/file_name.jar /databricks/jars/
cp /Workspace/jars/file_name.jar /databricks/databricks-hive/
```
- Configure the init script in the workspace in the Cluster configuration.
Expected:
- Cluster needs to start without any error.
- The jar has to be copied to the /databricks/databricks-hive/ folder.
Current Behaviour:
- The cluster is not starting.
- Init script is failing stating that the source file is not available.
Things already tried:
- Have tried file path with and without /Workspace - both are failing saying file is not available.
- I have also tried sleep for up to 2 minutes and the files are still not available.
- Have tried an init script that would just list the files in the path and print to a file. Even listing fails stating file/path is not available.