topic Re: Parameterize a notebook in Data Engineering

Parameterize a notebook

SarahDorich — Tue, 23 Nov 2021 17:26:29 GMT

I was wondering if there's a way to parameterize a notebook similar to how the Papermill library allows you to parameterize Jupyter notebooks?

Re: Parameterize a notebook

Anonymous — Tue, 23 Nov 2021 23:21:01 GMT

@Sarah Dorich - My name is Piper and I'm one of the moderators for Databricks. Thank you for asking! Let's give the community a while to respond or we'll circle back to this later. 🙂

Re: Parameterize a notebook

-werners- — Wed, 24 Nov 2021 08:45:46 GMT

you can try with widgets:

https://docs.databricks.com/notebooks/widgets.html

Not exactly the same as Papermill but it works fine. You can pass the values from your job orchestration tool into a widget so the notebook gets executed with the correct values.

I use this a lot with Azure Data Factory.