topic Re: How I could read the Job id, run id and parameters in python cell? in Data Engineering

How I could read the Job id, run id and parameters in python cell?

rammy — Thu, 15 Dec 2022 17:29:42 GMT

I have tried following ways to get job parameters but none of the things are working.

runId='{{run_id}}'
jobId='{{job_id}}'
filepath='{{filepath}}'
print(runId," ",jobId," ",filepath)
r1=dbutils.widgets.get('{{run_id}}')
f1=dbutils.widgets.get('{{filepath}}')
print(r1,f1)

any suggestions to get those parameters is really helpful

Re: How I could read the Job id, run id and parameters in python cell?

Vivian_Wilfred — Thu, 15 Dec 2022 20:50:24 GMT

Hi @Ramesh Bathini , have you tried using dbutils? try this,

%scala

print (dbutils.notebook.getContext().jobId)

print (dbutils.notebook.getContext().currentRunId)

%scala

val jobId = sc.getLocalProperty("spark.databricks.job.id")

val runId = sc.getLocalProperty("spark.databricks.job.runId")

print("jobId")

print("runId")

Re: How I could read the Job id, run id and parameters in python cell?

rammy — Fri, 16 Dec 2022 05:51:53 GMT

Thank you @Vivian Wilfred for your response. As you said i could read runId and JobId values but how can i read job parameters?

In above question, filepath is a job parameter that takes file path and that should be able to access inside the notebook. Which library can help me to read that?

Re: How I could read the Job id, run id and parameters in python cell?

Ajay-Pandey — Fri, 16 Dec 2022 06:55:04 GMT

Hi @Ramesh Bathini you can use below code -

curl "https://centralus.azuredatabricks.net/api/2.0/jobs/runs/list" -X GET -H "Authorization: Bearer dapia08sjflksjs9jfra6a34a"

Re: How I could read the Job id, run id and parameters in python cell?

Vivian_Wilfred — Fri, 16 Dec 2022 18:22:29 GMT

@Ramesh Bathini You mean the notebook file path that the job runs? For notebook file path you can try this:

%scala print(dbutils.notebook.getContext().extraContext("notebook_path"))

dbutils.notebook.getContext() has all the job parameters, You can query the output of this command to get the job details that you are looking for,

Let me know if this helps. Mark the comment as "best answer" to resolve the query. Thanks.

Re: How I could read the Job id, run id and parameters in python cell?

rammy — Sat, 17 Dec 2022 17:17:32 GMT

Thanks for your response. I found the solution. The below code gives me all the job parameters

all_args = dbutils.notebook.entry_point.getCurrentBindings()

print(all_args)

Thanks for your support

Re: How I could read the Job id, run id and parameters in python cell?

Siete — Tue, 20 May 2025 08:15:27 GMT

You should use {{job.id}} and {{job.run_id}} instead of with an underscore. This works for me.