@Debayan I'm having the same issue. I'm trying to run a Databricks workflow using an Azure service principal (not a Databricks service principal). The Azure service principal shows up in Databricks (via SCIM provisioning) as a "user" in Databricks.
The documentation from Azure on allowing the Azure service principal to clone a git repo is confusing, especially in light of how the git settings in the task of the Databricks workflow are set up.
I tried initially using a Databricks service principal, for which I could generate a client_id and a client_secret_id. However, of course the Databricks service principal has no access at all to Azure DevOps (git repos). So that didn't work.
It would be great if someone published an example of how to do this. Azure service principal running Databricks workflows that clone Azure DevOps repos to run code.
Thanks!