- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-15-2021 03:11 AM
As title, I need to clone code from my private git repo, and use it in my notebook,
I do something like
def cmd(command, cwd=None):
process = subprocess.Popen(command.split(), stdout=subprocess.PIPE, cwd=cwd)
output, error = process.communicate()
print (output.decode())
if error is not None:
print ("----\n"+error.decode())But I have to do this, redefine this function all the time.
I think this is cumbersome,
Is there a way that I could clone the repo into the "Repos" which databricks offered in the left side bar, and have full version control with databricks?
(I am not installing published packages from pip)
- Labels:
-
CloneRepository
-
Repository
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-15-2021 03:15 AM
Hi @Andy Huang , Yes, you can do it if it's accessible from Databricks. Please refer to:
https://docs.databricks.com/repos.html#repos-for-git-integration
Databricks does not support private Git servers, such as Git servers behind a VPN.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-15-2021 06:59 AM
I think it does support private git servers just for example in Azure you need to set network routing - vnet injection ( https://docs.microsoft.com/en-us/azure/databricks/administration-guide/cloud-configurations/azure/vn... ) and whitelist your internet gateway on git. So it will be seemed as any other git.
My blog: https://databrickster.medium.com/