topic child notebook is not displaying output. in Get Started Discussions

child notebook is not displaying output.

Verr — Mon, 13 May 2024 09:01:07 GMT

I have built pipeline to execute databricks notebook having SQL scripts. It is executing notebook but not able to see output for each cell. I am executing child notebook through driver notebook.

Re: child notebook is not displaying output.

koushiknpvs — Mon, 13 May 2024 16:21:36 GMT

Hi Verr,

In short it depends on how your child notebook is configured. But I would start with the following points -

Output Logging Settings: Check the logging settings for your notebook cells. Ensure that the cells are configured to display output. In Databricks notebooks, you can control the display of output using the %sql magic command or by explicitly using the display() function.
Cell Execution Order: Confirm that the cells are executing in the correct order. If a cell depends on the output of a previous cell, ensure that the previous cell has been executed successfully.
Error Handling: Check for any errors or exceptions that might be occurring during the execution of the notebook cells. Even if the notebook execution completes, errors in individual cells might prevent output from being displayed.
Logging Configuration: Ensure that your Databricks cluster's logging configuration is set up correctly. Sometimes, output might not be displayed due to misconfigurations in the cluster settings.
Pipeline Configuration: Review the configuration of your pipeline and ensure that it is correctly passing the necessary parameters and inputs to the notebook cells.
Permissions: Make sure that the user executing the pipeline has the necessary permissions to view the output of the notebook cells.

Re: child notebook is not displaying output.

Verr — Tue, 14 May 2024 11:08:11 GMT

To view the output of each cell of the child notebook within the child notebook itself, you would need to manually navigate to the child notebook and execute it there. This is a limitation of Databricks notebooks in the current environment.

This is because Databricks notebooks do not have the capability to display the output of each cell of a child notebook within the child notebook itself when executed from another notebook.