topic Re: external volume: overlap error with empty catalog? in Data Governance

external volume: overlap error with empty catalog?

-werners- — Tue, 19 Sep 2023 08:23:50 GMT

Hi all,

I try to create an external volume in a catalog/schema on a subpath of the external location.
This works fine, however for a certain path I cannot create an external volume. I always get
Input path url overlaps with managed storage within 'CreateVolume' call, for this path only.

However, there is nothing in our catalogs (fresh dev environment). So there cannot be any overlap!
This being a dev environment, we messed around trying unity out, so we are thinking perhaps unity caches some metadata of removed catalogs/tables/...?
Is there any way to find out where the issue could be located?
I already looked in system.information_schema, but there is nothing to be found.

Any thoughts?

Re: external volume: overlap error with empty catalog?

-werners- — Wed, 20 Sep 2023 11:55:36 GMT

point 1 and 2 can't be it as I have full permissions on all and the catalog is empty. Creating a volume on a subpath of this problematic directory works ...
How do I clear this cache? You mean browser cache or workspace cache?

Re: external volume: overlap error with empty catalog?

-werners- — Thu, 21 Sep 2023 12:22:50 GMT

I created a support request as this should not occur.

Re: external volume: overlap error with empty catalog?

owlleg6 — Thu, 29 Feb 2024 13:09:23 GMT

I have the same issue. I have created a Catalog using External Location, deleted it and now i can't create Volume for this Location even thought Catalog is deleted long ago

Re: external volume: overlap error with empty catalog?

-werners- — Thu, 29 Feb 2024 13:14:16 GMT

it is already a few months ago but I created a ticket for this. So the issue resolved itself after a while.
We believe that after 30 days Unity does a cleanup and the deleted items are scrapped completely.
Not sure if that is the case for you though. If not, I'd create a ticket too (after checking there is not actual overlap of course).

Re: external volume: overlap error with empty catalog?

-werners- — Thu, 29 Feb 2024 13:17:20 GMT

The issue disappeared by itself after a while (around 30 days) without Databricks support changing anything.
We (myself and databricks) suspect that a garbage collect or something freed locked paths.