Is there an automated way to strip notebook outputs prior to pushing to github?

[jimbender]

We have a team that works in Azure Databricks on notebooks.

We are not allowed to push any data to Github per corporate policy.

Instead of everyone having to always remember to clear their notebook outputs prior to commit and push, is there a way this can be automated?  Thanks in advance!! : ) 

[Kaniz · Accepted solution]

Hi @jimbender, Yes, there are ways to automate the process of clearing notebook outputs in Azure Databricks. 

Here are a couple of options:

Manual Clearing: Azure Databricks provides options to clear the notebook state and outputs. You can select one of the Clear options at the bottom of the Run menu. This is useful if you are sharing the notebook and do not want to include any results.

Automated Clearing: For an automated solution, you might need to write a script that exports each no.... However, this approach has some limitations. It will change the notebook ID, which will break bookmarks if people have them. Also, you’ll need to script this yourself using list API to list notebooks and directories and walk ....

I hope this helps! If you have any more questions, feel free to ask. 😊