topic Re: Have code stay hidden even when the notebook is copied in Get Started Discussions

Have code stay hidden even when the notebook is copied

DavidKxx — Fri, 12 Jan 2024 21:47:53 GMT

When I save a certain Python notebook where I have selected Hide Code and Hide Results on certain cells, those conditions persist. For example, when I come back the next day in a new session, the hidden material is still hidden.

When the notebook is copied into a new location by a CI/CD process after I have merged it into my main branch in git, the Hide actions seem to have been forgotten by, or never were known to, the copy of the notebook. That is, when I open the copy, the Code and the Results in those cells is now visible.

Is there a way to save the Hide actions more durably, so they would still be in force even in a copy of the notebook?

Re: Have code stay hidden even when the notebook is copied

Walter_C — Sat, 13 Jan 2024 15:56:26 GMT

In Databricks, the 'Hide Code' and 'Hide Results' actions are part of the interactive notebook UI and are not saved as part of the notebook source code. Therefore, these settings won't persist when the notebook is copied or moved to a new location through a CI/CD process.
As per the information, Git operations that alter the notebook source code result in the loss of the notebook state, which includes cell outputs, comments, version history, and widgets. This means that UI state, such as hidden code or results, would not be preserved through a Git operation.

Re: Have code stay hidden even when the notebook is copied

Alok7661 — Fri, 27 Sep 2024 16:15:35 GMT

I have faced the issue that notebook is throwing error memory output exceeds 30 MB and its getting failed(Error:run failed with error message The size of the run output (31467502 bytes) exceeds the limit (31457280 bytes).. I have then use this option to "Hide Result" for most of the df then it ran fine . But now I am worrying how this code will be worked when it get deployed to higher env using Git

Re: Have code stay hidden even when the notebook is copied

Walter_C — Tue, 01 Oct 2024 14:17:02 GMT

Normally when reaching the limit of the output size the suggestion is to split the notebook into smaller notebooks

Re: Have code stay hidden even when the notebook is copied

Alok7661 — Wed, 02 Oct 2024 15:34:51 GMT

In my situation we cannot split this notebook as ADF pipeline is already in PROD ,I have tried to use the option %%capture .It helps to ran the notebook within size limits but somehow it is corrupting the output. Also checked in the Databricks AI and got this result ."The %capture magic command is used in Jupyter notebooks to capture the output of a cell and prevent it from being displayed. However, in Databricks notebooks, this magic command is not supported."