10-18-2021 07:17 AM
Hi, we are testing the new Files support in Databricks repos. Is there a way how to programmatically read notebooks?
Thanks
11-23-2021 07:37 PM
Hi @Jiri Koutny these files anyway should be synced to your remote repository (git, bitbucket, GitLab etc). The APIs from version control tools Git API for example might help you achieve what you want.
https://stackoverflow.com/questions/38491722/reading-a-github-file-using-python-returns-html-tags
#!/usr/bin/env python3
import base64
import requests
url = 'https://api.github.com/repos/{user}/{repo_name}/contents/{path_to_file}'
req = requests.get(url)
if req.status_code == requests.codes.ok:
req = req.json() # the response is a JSON
# req is now a dict with keys: name, encoding, url, size ...
# and content. But it is encoded with base64.
content = base64.decodestring(req['content'])
else:
print('Content was not found.')
10-18-2021 07:22 AM
Hi @ Jiri Koutny! My name is Kaniz, and I'm the technical moderator here. Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question first. Or else I will get back to you soon. Thanks.
10-18-2021 07:24 AM
Thanks @Kaniz Fatma for quick reply. Looking forward to the answers 🙂
10-20-2021 12:34 AM
Hi @Jiri Koutny , Just wanted to understand if you need help with Python Repo files or just local python file? Can you please be more specific?
10-20-2021 02:25 AM
10-20-2021 02:42 AM
Thank you for sharing this.
11-10-2021 08:06 AM
@Jiri Koutny Alternatively, using export API, you can download it and use
curl -n -o example.scala \
'https://<databricks-instance>/api/2.0/workspace/export?path=/Users/user@example.com/ScalaExampleNotebook&direct_download=true'
Documentation https://docs.databricks.com/dev-tools/api/latest/workspace.html#export
11-11-2021 12:21 AM
Hi Sandeep, is it really possible to download files (not notebooks) from Repos using the export API? Last time I tried, only notebooks were exported and all files were skipped...
11-23-2021 07:37 PM
Hi @Jiri Koutny these files anyway should be synced to your remote repository (git, bitbucket, GitLab etc). The APIs from version control tools Git API for example might help you achieve what you want.
https://stackoverflow.com/questions/38491722/reading-a-github-file-using-python-returns-html-tags
#!/usr/bin/env python3
import base64
import requests
url = 'https://api.github.com/repos/{user}/{repo_name}/contents/{path_to_file}'
req = requests.get(url)
if req.status_code == requests.codes.ok:
req = req.json() # the response is a JSON
# req is now a dict with keys: name, encoding, url, size ...
# and content. But it is encoded with base64.
content = base64.decodestring(req['content'])
else:
print('Content was not found.')
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.