Repos configuration for Azure Service Principal

[pantelis_mare]

Hello community!

I would like to update a repo from within my Azure DevOps release pipeline.

In the pipeline I generate a token using a AAD Service Principal as recommended, and I setup the databricks api using that token.

When I pass the databricks repos update command, I receive an authenitcation error, which is expected and the service principal has not git configured on the workspace side.

My question is:

Can I configure the repos for the SPN programmatically?

Or, is there a way to provide an Azure Devops token when I make the databricks api call? I have tried passing a token by setting the git AZURE_DEVOPS_EXT_PAT but it doesn't seem to work.

Thank you in advance!

[davidfengler]

Microsoft released "Service principal and managed identity support in Azure DevOps

" end of march -> https://learn.microsoft.com/en-us/azure/devops/release-notes/2023/sprint-219-update#service-principa...

does this helps to get this working? my job shows the same issue as before when executing with the service principal without setting git_credentials

[xiangzhu]

traditional PAT may have long lifespn, but the new SP feature uses an AAD token which should have a much shorter lifespqn, maybe around one hour, this could be a limiting factor.

However, I haven't tested this yet, so these are merely hypotheses.

Nevertheless, even if it does work with SP, running dbt or notebooks through Git or workspace does not seem like a good idea in terms of operational risk. Packaging everything into an artifact, such as a spark_python_task, appears to be a much better approach.