cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

child notebook is not displaying output.

Verr
New Contributor II

I have built pipeline to execute databricks notebook having SQL scripts. It is executing notebook but not able to see output for each cell. I am executing child notebook through driver notebook.

2 REPLIES 2

koushiknpvs
New Contributor III

Hi Verr,

In short it depends on how your child notebook is configured. But I would start with the following points -

  1. Output Logging Settings: Check the logging settings for your notebook cells. Ensure that the cells are configured to display output. In Databricks notebooks, you can control the display of output using the %sql magic command or by explicitly using the display() function.

  2. Cell Execution Order: Confirm that the cells are executing in the correct order. If a cell depends on the output of a previous cell, ensure that the previous cell has been executed successfully.

  3. Error Handling: Check for any errors or exceptions that might be occurring during the execution of the notebook cells. Even if the notebook execution completes, errors in individual cells might prevent output from being displayed.

  4. Logging Configuration: Ensure that your Databricks cluster's logging configuration is set up correctly. Sometimes, output might not be displayed due to misconfigurations in the cluster settings.

  5. Pipeline Configuration: Review the configuration of your pipeline and ensure that it is correctly passing the necessary parameters and inputs to the notebook cells.

  6. Permissions: Make sure that the user executing the pipeline has the necessary permissions to view the output of the notebook cells.

Verr
New Contributor II

To view the output of each cell of the child notebook within the child notebook itself, you would need to manually navigate to the child notebook and execute it there. This is a limitation of Databricks notebooks in the current environment. 

This is because Databricks notebooks do not have the capability to display the output of each cell of a child notebook within the child notebook itself when executed from another notebook.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!