CLuster Config

Naren1 — Fri, 09 Jan 2026 13:25:15 GMT

Hi, can we pass a parameter into job activity from ADF side to change the environment inside the job cluster configuration?

Re: CLuster Config

K_Anudeep — Fri, 09 Jan 2026 13:44:08 GMT

Hello @Naren1 ,

Yes — you can pass parameters from ADF to a Databricks Job run, but you generally can’t use those parameters to change the job cluster configuration (node type, Spark version, autoscale, init scripts, etc.) for that run.
In an ADF Databricks Job activity, the supported runtime customization is jobParameters (key-value pairs) that get passed into the job run. Doc: https://learn.microsoft.com/en-us/azure/data-factory/transform-data-databricks-job#databricks-job-activity-definition. With the Job activity, ADF would run an existing Databricks jobId, optionally with jobParameters.

Would you please help me understand what do you mean by environment -- different libraries? different Spark version? different node size?

topic Re: CLuster Config in Data Engineering

CLuster Config

Re: CLuster Config