Hi @saurabh18cs ,

In my case we are generating Databricks jobs through Terraform. And for job details we are passing JSON files. We deploy the same JSON in different environments like dev, sit and uat.

But when we have run_job task, it requires the job_id of the Databricks job, and in each environment the same job_name will have the different job_id so here is the issue.

Example:

{
  "name": "RUN_JOB_TEST",
  "email_notifications": {
    "no_alert_for_skipped_runs": false
  },
  "webhook_notifications": {},
  "timeout_seconds": 0,
  "max_concurrent_runs": 1,
  "tasks": [
    {
      "task_key": "RUN_JOB_TEST",
      "run_if": "ALL_SUCCESS",
      "run_job_task": {
        "job_id": 370187610293026
      },
      "timeout_seconds": 0,
      "email_notifications": {}
    }
  ],
  "queue": {
    "enabled": true
  },
  "run_as": {
    "user_name": "abc@xyz.com"
  }
}

Now, this configuration will works fine in dev environment but when we deploy the same json in sit, it fails as the job_id value is incorrect.