topic Re: Python Databricks how to run all cells in another notebook except the last cell in Data Engineering

Python Databricks how to run all cells in another notebook except the last cell

jerryrard — Fri, 02 Feb 2024 19:04:34 GMT

I have a Python Databricks notebook which I want to call/run another Databricks notebook using dbutils.notebook.run()... but I want to run all the cells in the "called" notebook except the last one.

Is there a way to do a count of cells in the called notebook? And then run the called notebook on all cells until CellCount-1 ?

Re: Python Databricks how to run all cells in another notebook except the last cell

Lakshay — Fri, 02 Feb 2024 19:39:00 GMT

I don't think this is possible. You can only complete a notebook.
BTW curious to know what is the use-case here.

Re: Python Databricks how to run all cells in another notebook except the last cell

feiyun0112 — Sat, 03 Feb 2024 01:53:26 GMT

In the alternative way, you can use dbutils.notebook.run to pass the parameters, and use dbutils.widgets.get in another notebook to get the parameter values,

and determine the parameter values to decide whether to execute codes in the specified cell

https://docs.databricks.com/en/notebooks/notebook-workflows.html#example