cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Parameterize a notebook

SarahDorich
New Contributor II

I was wondering if there's a way to parameterize a notebook similar to how the Papermill library allows you to parameterize Jupyter notebooks?

1 ACCEPTED SOLUTION

Accepted Solutions

-werners-
Esteemed Contributor III

you can try with widgets:

https://docs.databricks.com/notebooks/widgets.html

Not exactly the same as Papermill but it works fine. You can pass the values from your job orchestration tool into a widget so the notebook gets executed with the correct values.

I use this a lot with Azure Data Factory.

View solution in original post

2 REPLIES 2

Anonymous
Not applicable

@Sarah Dorichโ€‹ - My name is Piper and I'm one of the moderators for Databricks. Thank you for asking! Let's give the community a while to respond or we'll circle back to this later. ๐Ÿ™‚

-werners-
Esteemed Contributor III

you can try with widgets:

https://docs.databricks.com/notebooks/widgets.html

Not exactly the same as Papermill but it works fine. You can pass the values from your job orchestration tool into a widget so the notebook gets executed with the correct values.

I use this a lot with Azure Data Factory.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group