topic %run not printing notebook output when using 'Run All' command in Data Engineering

%run not printing notebook output when using 'Run All' command

aaronpetry — Thu, 13 Oct 2022 19:33:23 GMT

I have been using the %run command to run auxiliary notebooks from an "orchestration" notebook. I like using %run over dbutils.notebook.run because of the variable inheritance, troubleshooting ease, and the printing of the output from the auxiliary notebooks to the orchestration notebook.

Yesterday, when I was using %run, it was working as expected. Today, when I use %run, it is acting differently.

1. I no longer have to send arguments using the following:

%run ./some-notebook $var = arg $var2 = arg

Instead, it is sending var and var2 defined elsewhere in the notebook.

2. When using 'Run All' from the tool bar, the %run command no longer prints the output of the auxiliary notebook. It only shows the execution time. However, if I run the command individually (shift+enter in the cell), it will show the output. Is there a way to be able to run the whole notebook and still see the %run output?

Thank you!

Re: %run not printing notebook output when using 'Run All' command

Anonymous — Fri, 25 Nov 2022 06:38:50 GMT

Hi @Aaron Petry

Great to meet you, and thanks for your question!

Let's see if your peers in the community have an answer to your question first. Or else bricksters will get back to you soon.

Thanks

Re: %run not printing notebook output when using 'Run All' command

aaronpetry — Mon, 05 Dec 2022 16:37:24 GMT

Hi Vidula,

No worries! What I've found is that if I create a new command with the same %run command, it will then show the output. It will work for some time until it decides it doesn't want to show output anymore, so then I just create a new command with the same %run line, and then it starts to work again. This should be okay for the time being.

Aaron