Widgets - Way to validate config parameters

Digan_Parikh — Wed, 09 Jun 2021 20:47:03 GMT

Yes, you can use the widgets api to have some control to validate the input before you pass the values to the rest of your code

For example:

folder = dbutils.widgets.get("Folder")
if folder == "":
    raise Exception("Folder missing")

or to get spark settings you can use:

spark.conf.get("my_property")

topic Widgets - Way to validate config parameters in Data Engineering