03-13-2022 04:20 PM
"Arbitrary files in Databricks Repos", allowing not just notebooks to be added to repos, is in Public Preview. I've tried to activate it following the instructions in the above link but the option doesn't appear in Admin Console. Minimum requirements are stated as "you must be running Databricks Runtime 8.4 or above". My cluster is running Runtime 10.3.
I have successfully integrated with my repos in Github but only notebook files are shown.
Repos section of Admin Console (with no "Files in Repos" toggle):
Repos screenshot showing I can only create a folder or a notebook (not a file):
How do I enable this feature?
03-21-2022 08:48 AM
Hi @Tom Turner ,
Databricks offers a number of plans that provide you with dedicated support and timely service for the Databricks platform and Apache Spark.
If you are already an authorised Databricks support contact for your organisation, this article shows you how to manage the support process.
Your organisation must have a Databricks Support contract and your email address must be registered as an authorised support contact. See Enable and create contacts (admin only).
Can you please file a support ticket?
If you would like to learn more about purchasing a Databricks Support contract, contact us using this request form.
03-14-2022 03:19 AM
Files in Repos have to be enabled in admin console than you can create python files in IDE. Just clone repo to your local machine and create files there, push to git and pull in databricks.
03-14-2022 03:34 AM
Thanks for your help. Unfortunately the option to enable this feature is not available to me in the Admin Console (see screenshot in my original post). I have cloned a repo from github that contains numerous files but none of these are available in Databricks (only the empty folders are shown).
03-14-2022 12:18 PM
What environment is your deployment in?
03-14-2022 12:20 PM
AWS
03-14-2022 12:26 PM
are you on single tenant by any chance?
03-14-2022 05:20 PM
I'm not sure. I'm using the AWS Standard (rather than Premium or Enterprise) version. I believe this is multi-tenant?
03-14-2022 05:28 PM
Deployed on eu-west-1
03-21-2022 04:55 AM
Hi @Tom Turner ,
An admin can enable this feature as follows:
After the feature has been enabled, you must restart your cluster and refresh your browser before you can use Files in Repos.
Additionally, the first time you access a repo after Files in Repos is enabled, you must open the Git dialog. A dialog appears indicating that you must perform a pull operation to sync non-notebook files in the repo. Select Agree and Pull to sync files. If there are any merge conflicts, another dialog appears giving you the option of discarding your conflicting changes or pushing your changes to a new branch.
You can use the command
%sh pwd
in a notebook inside a Repo to check if Files in Repos is enabled.
/databricks/driver
/Workspace/Repos/<path to notebook directory>
03-21-2022 05:00 AM
03-21-2022 05:13 AM
Please write to AWS support. This option is in public preview and should be available. It seems that your databricks control panel in eu-west-1 is in older version
03-21-2022 05:16 AM
Thanks but I suspect Databricks support are better placed than AWS support to fix this. AWS are only providing the infra layer (which is working fine), not the software.
03-21-2022 05:22 AM
Hi @Tom Turner , After the feature has been enabled, you must restart your cluster and refresh your browser before you can use Files in Repos.
03-21-2022 05:25 AM
@Kaniz Fatma Thanks but how can I enable the feature if it is not available in the admin console?
03-21-2022 05:43 AM
they collaborate on higher level, with development support in AWS you can sent request. If you don't have support plan in AWS please submit ticket here https://help.databricks.com/s/submitrequest
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group