Unfortunately this is expected behavior. We only support 1 Git credential at a time per user in the workspace. We are adding a sample notebook in this section to help you swap Git credentials more easily.
https://docs.databricks.com/en/repos/repos-setup.html#add-or-edit-git-credentials-in-databricks
