topic Re: Accessing Job parameters using cluster v15.4 in Data Engineering

Accessing Job parameters using cluster v15.4

data_mifflin — Fri, 21 Feb 2025 13:34:30 GMT

After upgrading databricks cluster to version 15.4, is there any way to access job parameters in notebook except the following way ?
dbutils.widgets.get("parameter_name")

In v15.4, dbutils.notebook.entry_point.getCurrentBindings() has been discontinued.

Re: Accessing Job parameters using cluster v15.4

Alberto_Umana — Fri, 21 Feb 2025 13:38:36 GMT

Hi @data_mifflin - Unfortunately I could not find any other way than: dbutils.widgets.get("parameter_name") but let me check internally.

Re: Accessing Job parameters using cluster v15.4

data_mifflin — Fri, 21 Feb 2025 13:40:25 GMT

Thanks Alberto, for looking into it !

Re: Accessing Job parameters using cluster v15.4

data_mifflin — Mon, 24 Feb 2025 13:17:43 GMT

@Alberto_Umana , did you find anything ?

Re: Accessing Job parameters using cluster v15.4

Pawan1979 — Mon, 24 Feb 2025 15:57:35 GMT

For me it is working at 15.4 LTS (includes Apache Spark 3.5.0, Scala 2.12)

Re: Accessing Job parameters using cluster v15.4

data_mifflin — Thu, 27 Feb 2025 08:08:18 GMT

@Pawan1979 , are you using Scala or pyspark ?
I am using pyspark, and it is not working.

Re: Accessing Job parameters using cluster v15.4

data_mifflin — Thu, 27 Feb 2025 08:10:56 GMT

@Alberto_Umana , did you check internally ?