cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to specify init file path

Brad
Contributor II

Hi team,

I want to create a job and install some libs to job cluster.

1. For job cluster, understand we can specify libraries under task, but if I want to install the lib to the whole cluster seems the only way is to use init script right?

2. In my env, I want to put the init script directly with source code instead of uploading to DBFS first. I need to specify an absolute path for it like 

/Workspace/Users/.../.bundle/.../files/src/bash/xxx.sh

Is there a way to dynamically specify the user ID as it can be different in different env?

Thanks

0 REPLIES 0