Unclear validation error message when adding a Unity Catalog metastore in Azure

[alexlod]

I'm using Azure Databricks.

I've been following this guide to create a Unity Catalog metastore using a managed identity.

When I create the catalog and the validation step kicks off, I get this screen:

 

What does this mean?

If I click "Force create" and then assign the metastore to a workspace, I'm not able to write anything to the metastore. Eg, doing a simple "CREATE TABLE main.default.test" yields the following error:

[RequestId=<uuid> ErrorClass=INVALID_STATE] Failed to access cloud storage: AbfsRestOperationException exceptionTraceId=<uuid>

I believe that the failed validation is correct given I can't create a table, but I have no idea what's wrong. Any thoughts or pointers?

EDIT: formatting.

UPDATE: When creating the metastore, the "ADLS Gen 2 path" must exist in the storage container. Meaning, if the ADLS Gen 2 path value is "foo@bar.dfs.core.windows.net/baz", the "baz" folder must exist in the "foo" container. That gets the validation to pass. However, creating a table still creates the same error mentioned above.

UPDATE2: The issue was fully resolved by @Tom Smith​'s comment in this thread, which recommends to follow the upgrade documentation.

[Debayan]

Hi, Please look at the similar thread and let us know if that helps.

[alexlod]

Hi @Debayan Mukherjee​, unfortunately that other thread isn't helpful because it's about AWS and I'm using Azure. Any other ideas? Thanks!

[alexlod · Accepted solution]

I found the solution here: https://community.databricks.com/s/question/0D58Y00009pvzofSAA/unity-catalogerror-creating-table-err...

[alexlod]

Read my "UPDATE2" for the answer/solution.

[Anonymous]

Hi @Alex Loddengaard​ 

Hope everything is going great.

Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you. 

Cheers!