Unclear validation error message when adding a Unity Catalog metastore in Azure

alexlod
New Contributor III

I'm using Azure Databricks.

I've been following this guide to create a Unity Catalog metastore using a managed identity.

When I create the catalog and the validation step kicks off, I get this screen:

Screenshot 2023-02-07 at 1.06.40 PM 

What does this mean?

If I click "Force create" and then assign the metastore to a workspace, I'm not able to write anything to the metastore. Eg, doing a simple "CREATE TABLE main.default.test" yields the following error:

[RequestId=<uuid> ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException exceptionTraceId=<uuid>

I believe that the failed validation is correct given I can't create a table, but I have no idea what's wrong. Any thoughts or pointers?

EDIT: formatting.

UPDATE: When creating the metastore, the "ADLS Gen 2 path" must exist in the storage container. Meaning, if the ADLS Gen 2 path value is "foo@bar.dfs.core.windows.net/baz", the "baz" folder must exist in the "foo" container. That gets the validation to pass. However, creating a table still creates the same error mentioned above.

UPDATE2: The issue was fully resolved by @Tom Smith​'s comment in this thread, which recommends to follow the upgrade documentation.