topic Re: GitLab integration in Data Engineering

GitLab integration

Giorgi — Tue, 30 Aug 2022 15:16:05 GMT

I've followed instructions and did gitlab integration:

Generated Personal Access Token from GitLab
Add token (from step 1) to User settings (GitLab, email, token)
In Admin console -> Repos Git URL Allow List permissions: Disabled (no restrictions)
In Admin console -> Repos Git URL Allow List: https:.....*.git
Pull works
Push does not: The remote Git repo URL linked to this repo is not listed in the ALLOW list configured by your Workspace admin.

Am I missing some step?

Thanks for help !

Re: GitLab integration

Hubert-Dudek — Tue, 30 Aug 2022 16:05:33 GMT

"In Admin console -> Repos Git URL Allow List permissions: Disabled (no restrictions)."

Here I am using "only restrict .." give it a try 🙂

"In Admin console -> Repos Git URL Allow List: https:.....*.git"

Here just put only domain and separate it by commas, for example:

https://dev.azure.com/,https://gitlab.mycompany.com/

Re: GitLab integration

joshuat — Wed, 24 Jul 2024 17:52:27 GMT

I'd like to resurrect this thread, as there's no solution posted yet. When I try to push a branch from Databricks, I am receiving

Error pushing changes. Remote ref update was rejected. Make sure you have write access to this remote repository.

My repo is located on gitlab.com. Setup:

In the Databricks Linked account settings, I've tried Git `username` as my corporate email in Gitlab. I've also tried `username` as my GitLab account name
In the Databricks Linked account settings, I've tried `GitLab` and `Gitlab Enterprise Edition` as the Git provider.
In the Databricks Admin settings, I have enabled "Restrict Clone, Commit & Push to allowed Git repositories" and set the URL allow list to "https://gitlab.com"
My HTTPS GitLab token has `read_repository, write_repository` scopes with a Maintainer role.

Like OP, I can `git pull` the successfully but `push` fails. On the Databricks clone of the repo, all I have done is create a test file with one line in the root directory and update an existing file in the root directory with a single uncommented line. Please help!

Re: GitLab integration

joshuat — Wed, 24 Jul 2024 18:29:46 GMT

Discovered the solution to my problem - Databricks Git integration does not support the use of project-level access tokens. It only supports the use of user-level personal access tokens. When I switched my Git credentials to use a personal access token AND my corporate email according to GitLab, it worked.

Re: GitLab integration

nicole_lu_PM — Mon, 07 Oct 2024 17:30:21 GMT

> Databricks Git integration does not support the use of project-level access tokens

Thank you for reporting this issue. Gitlab project access tokens stopped working sometime after May 2024. The issue is on our backlog. Are you able to use an alternative to unblock your work?

Re: GitLab integration

joshuat — Mon, 07 Oct 2024 19:55:21 GMT

Thanks for your reply - I did, see my reply above.