topic Revert cluster DBR version to last DBR in Data Engineering

Revert cluster DBR version to last DBR

ayushmangal72 — Tue, 25 Mar 2025 11:24:47 GMT

Hi Team,

We have updated our clusters DBR version, later we got to know that some of our jobs started failing, now we wanted to revert to DBR version to the previos one only but we forgot the DBR version on which job was running fine.

Is there any way to find that out?

Re: Revert cluster DBR version to last DBR

adhi_databricks — Tue, 25 Mar 2025 15:56:06 GMT

Hey @ayushmangal72 , try using the Databricks Job Run API (/api/2.2/jobs/runs/list) to fetch older run IDs for the job.

Once you have the run_id, make a request to the API at /api/2.2/jobs/runs/get. You'll be able to find the DBR version in the API response (I’ve provided a sample response where the DBR version can be found).

"job_clusters": [ { "job_cluster_key": "auto_scaling_cluster", "new_cluster": { "autoscale": { "max_workers": 16, "min_workers": 2 }, "node_type_id": null, "spark_conf": { "spark.speculation": true }, "spark_version": "7.3.x-scala2.12" } } ],

Re: Revert cluster DBR version to last DBR

ayushmangal72 — Wed, 26 Mar 2025 11:39:29 GMT

Thank you for your reply, I also found an another solution, checked the event_logs and there old DBR versions was mentioned.