topic Re: Init Script not 'Absolute' in missing-QuestionPost

Init Script not 'Absolute'

alexiswl — Fri, 23 Jun 2023 06:17:42 GMT

Hello,

I am trying to use an init script from my repo workspace.

The cluster is a 'personal compute' cluster with single user access mode with the following runtime version: '13.1 (includes Apache Spark 3.4.0, Scala 2.12)'

I have 'Files in Repos' set to 'DBR 8.4+' in my workspace settings.

I used the 'workspace' option (not dbfs, or s3) in the destination settings for the init script dropdown.

Unfortunately I am getting the following error on Cluster Startup.

```json

{

"reason": {

"code": "INIT_SCRIPT_FAILURE",

"type": "CLIENT_ERROR",

"parameters": {

"instance_id": "i-0f585b1a60a28a8b1",

"databricks_error_message": "BAD_REQUEST: requirement failed: /Workspace/Repos/services+databricks@umccr.org/data-portal-analytics/notebooks/RPackagesToInstall.sh is not absolute."

}

"add_node_failure_details": {

"failure_count": 1,

"resource_type": "container",

"will_retry": false

}

```

Re: Init Script not 'Absolute'

alexiswl — Fri, 23 Jun 2023 08:59:38 GMT

Hi @Debayan

> Looks like it is not able to get the package from the repo.

Not sure what you mean by this?

I managed to resolve the issue (also couldn't find the log files after setting the logging to dbfs://cluster-logs/ which was strange).

In this case, I think had a sneaky space character before '/Workspace' which caused my issue.

After that resolved, I got an error saying that this path didn't exist.

My guess was that by selecting workspace in the destination settings dropdown menu, I was already in the /workspace directory.

Hence by using `/Repos/services+databricks@umccr.org/data-portal-analytics/notebooks/RPackagesToInstall.sh` instead I was able to run the init script successfully.

Is there any examples of init scripts when using repos available? I couldn't find any. This could be quite useful for others!

Alexis

Re: Init Script not 'Absolute'

Debayan — Fri, 23 Jun 2023 07:05:20 GMT

Hi, could you please enable init script logging and provide the elaborated logs here? Looks like it is not able to get the package from the repo.

https://docs.databricks.com/clusters/init-scripts.html#init-script-logging

Also, please tag @Debayan Mukherjee with your next update so that I will get notified.