How to specify init file path
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-18-2025 05:32 PM
Hi team,
I want to create a job and install some libs to job cluster.
1. For job cluster, understand we can specify libraries under task, but if I want to install the lib to the whole cluster seems the only way is to use init script right?
2. In my env, I want to put the init script directly with source code instead of uploading to DBFS first. I need to specify an absolute path for it like
/Workspace/Users/.../.bundle/.../files/src/bash/xxx.shIs there a way to dynamically specify the user ID as it can be different in different env?
Thanks
- Labels:
-
Workflows
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-12-2025 07:28 PM
There is no direct method to dynamically specify the user ID in this path across environments.
If dynamic determination of the user ID per environment is essential, you may need additional scripting or automation to set the correct path before executing the init configuration. Alternatively, consider structuring paths and environments consistently to avoid hardcoding specific user IDs
