"Azure Container Does Not Exist" when cloning repositories in Azure Databricks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-02-2024 02:54 AM
Good Morning, I need some help with the following issue:
I created a new Azure Databricks resource using the vnet-injection procedure. (here)
I then proceeded to link my Azure Devops account using a personal account token.
If I try to clone a repository I get an error message saying:
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-03-2024 03:36 AM
Hi @Retired_mod many thanks for your reply.
I have verified that repository works in another (older) databricks workspace. When I try to clone into a new databricks instance, it creates subfolders but won't copy the files. I have attached a screencap of the error message for your convenience.
How do I check the Unity Catalog settings for lingering references? The account admin removed this workspace from the Unity Catalog, is there anywhere else where we should be looking at?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2024 09:58 AM
Any solution to this, I too facing same issue
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2024 06:47 PM
There are three possible causes.
- The Azure container might not have been properly created when the workspace was provisioned.
- The Azure container might have been deleted or moved after it was created.
- There might be a problem with the permissions or roles assigned to the user or service principal trying to access the Azure container.
In your case it seems to be the permission issue or if the container is deleted.
There are a couple of potential solutions:
- If the workspace is new, you could delete and create a new workspace. This might solve the issue if the problem was caused by an error during the provisioning process.
- You could also reach out to the PG team to investigate what happened during the provisioning of the workspace and why the Azure container was not created.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2024 04:55 AM
I've come across similar responses in many articles regarding the "Azure Container Does Not Exist" error, but none of them have been helpful. In both the error and responses, people suggest checking the Azure container, but no one specifies where to check or what permissions are needed. If anyone could provide detailed troubleshooting steps for this error, it would be greatly appreciated.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-09-2025 01:49 AM - edited 01-09-2025 01:51 AM
Hello,
my understanding is that some unspecified error happens in the managed resource group that DB creates when you deploy a new instance. Depending on your admin right you might not even be able to see such group in Azure (as in my case).
What has worked for me was to delete the instance and redeploy from scratch. I have deployed several new instances of DB in different resource groups since my original post and the problem has occasionally surfaced again, but deleting and redeploying has always done the trick.
Hope it helps!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2024 11:11 AM
I found my error was related to my use of Pulumi (or in this other answer Terraform)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-08-2025 03:23 PM
To troubleshoot the "Azure Container Does Not Exist" error, follow these steps:
-
Confirm the Azure Container Exists:
- Verify that the Azure container exists in the specified resource group and subscription. If it has been deleted or moved, recreate it in the correct location.
-
Check Permissions:
- Ensure that the user or service principal has the necessary permissions to access and create files in the Azure container. Adjust the roles and permissions as needed.
-
Workspace Provisioning:
- If the workspace is newly deployed and the issue persists, consider deleting and recreating the workspace. This can resolve issues caused by errors during the initial provisioning process.
-
Investigate Provisioning Errors:
- If the Azure container was not properly created during the workspace provisioning, there might have been an error during the process. You can reach out to the product team to investigate what happened during the provisioning of the workspace and why the Azure container was not created.
By following these steps, you should be able to resolve the "Azure Container Does Not Exist" error.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-08-2025 03:32 PM
Please find this KB I just landed on - https://kb.databricks.com/en_US/cloud/azure-container-does-not-exist-error-when-creating-files-in-a-...
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-10-2025 08:01 AM
Thank you Everyone for helping me with this issue.. My issue got resolved after recreating the workspace.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2025 04:55 AM
Hi
Also having problems with this after some IaC testing deleting and recreating the workspace with the same name. We are working in Azure.
Is the "container" referred to, the container in the storage account deployed by Databricks Instance into the managed resource group ?
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-25-2025 11:29 PM
Yes, the container is indeed the container in the storage account deployed by the Databricks instance into the managed resource group. This storage account is part of the managed resource group associated with your Azure Databricks workspace.
If the workspace is newly deployed workspace, consider deleting and recreating the workspace.
Can you please try recreating the