Hi folks, I am trying a particular use case, where I need to schedule a run of three different notebooks(pyspark,sql code) in sequence ​I need to use ...

Data Engineering

Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.

Hi folks,

I am trying a particular use case, where I need to schedule a run of three different notebooks(pyspark,sql code) in sequence

I need to use date field as a common parameter in all three (date is part of the sql query in each nb where clause), so I can change date at one place and run all three nb with same parameter value.(instead of tweaking each nb individually )

I don't see any straight forward way, do you have any suggestions ?

tried widgets but open for other creative ways.