I've got an ADLS Gen 2 container that has cloud files that I want to ingest with AutoLoader. The files are saved into the root of the container.

I created an external location for that container to be able to access it through managed credentials. However, in my script used to set it up, I also accidentally created a catalog, schema, and table as a test to validate access. No problem, I thought. I deleted the catalog within databricks, and then deleted __unitystorage directory & files.

However, now when I try to have autoloader access the files in that container I'm getting the following error:

AnalysisException: [RequestId=8f219926-d946-4601-a683-18495a6ded8f ErrorClass=INVALID_PARAMETER_VALUE.LOCATION_OVERLAP] Input path url 'abfss://container@mystorageaccount.dfs.core.windows.net/' overlaps with managed storage within 'CheckPathAccess' call.

If I try and delete the external location from Unity Catalog, Databricks prompts me that it can't delete it due to the location having 1 dependent managed tables.

I used the Force delete option, and then re-added the external location, and I'm still getting LOCATION_OVERLAP exception when trying to read the files with AutoLoader.

I tried using SHOW DROPPED TABLES, but that doesn't work cause as the catalog was dropped first.

Does anyone have any suggestions on how I can get UC to recognize that this container root is no longer being used for any managed resources?