topic Re: Saving complete notebooks to GitHub from Databricks repos. in Data Engineering

Saving complete notebooks to GitHub from Databricks repos.

Serhii — Mon, 14 Feb 2022 18:28:24 GMT

When saving notebook to GiHub repo, it is stripped to Python source code. Is it possible to save it in the ipynb formt?

Re: Saving complete notebooks to GitHub from Databricks repos.

-werners- — Tue, 15 Feb 2022 07:11:31 GMT

as git is a repository for source code it is logical it is converted to py files as these can be run as a job.

Is this what you look for?

https://github.com/Yoyodyne-Data-Science/ipynb-py-convert-databricks

Re: Saving complete notebooks to GitHub from Databricks repos.

Serhii — Tue, 15 Feb 2022 07:52:45 GMT

Exactly - thanks for pointing out!

Re: Saving complete notebooks to GitHub from Databricks repos.

-werners- — Tue, 15 Feb 2022 11:09:23 GMT

you can also use the databricks cli. There is a jupyter format option.

https://docs.microsoft.com/en-us/azure/databricks/dev-tools/cli/workspace-cli

Re: Saving complete notebooks to GitHub from Databricks repos.

Anonymous — Tue, 15 Feb 2022 13:52:47 GMT

The notesbooks save to git are in .py format. The code that is markdown or magic commands get commented out. If you reload it as a notebook, then it will render that markdown and code again. Here is what the python would look like

# Databricks notebook source
# INCLUDE_HEADER_TRUE
# INCLUDE_FOOTER_TRUE
 
# COMMAND ----------
 
# MAGIC %md 
# MAGIC # Databricks Platform
# MAGIC

Re: Saving complete notebooks to GitHub from Databricks repos.

Anonymous — Tue, 22 Feb 2022 22:31:00 GMT

Awesome ideas and responses here in this thread @Werner Stinckens @Joseph Kambourakis ! Thanks for helping out!

@Sergii Ivakhno If you got what you needed, please let us know by selecting the "best answer"! This helps the community see when a question has its answer! 😊

Re: Saving complete notebooks to GitHub from Databricks repos.

GlennStrycker — Tue, 12 Mar 2024 20:33:50 GMT

When I save+commit+push my .ipynb file to my linked git repo, I noticed that only the cell inputs are saved, not the output. This differs from the .ipynb file I get when I choose "File / Export / iPython Notebook". Is there a way to save the cell outputs in my git commit as well?

Re: Saving complete notebooks to GitHub from Databricks repos.

GlennStrycker — Tue, 12 Mar 2024 20:57:01 GMT

Solved in my other thread:

https://community.databricks.com/t5/data-engineering/saving-ipynb-notebooks-to-git-does-not-include-output-cells/m-p/63434/thread-id/32239#M32240