topic Re: Error: "Access validation failed" and error detail is "PERMISSION_DENIED: Cannot find shard endpoint for shard az-eastasia" in Data Governance

Error: "Access validation failed" and error detail is "PERMISSION_DENIED: Cannot find shard endpoint for shard az-eastasia"

joe_zhou — Tue, 24 Jan 2023 08:12:26 GMT

Getting the error message as below:

when following the tutorial:

in the section of "Create your first metastore and attach a workspace" with both storage and connector information filled and then click create.

Have googled the error with key work metastore but haven't found any useful information.

Any help on how to succeed with creating a metastore would be deeply appreciated.

Ajay-Pandey — Tue, 24 Jan 2023 10:29:38 GMT

Hi @joe zhou Your storage account must be in the same region where you have created your databricks workspace.

Please check this once

joe_zhou — Tue, 24 Jan 2023 12:10:04 GMT

Thanks Ajay. However, I've double checked, the storage account is in the same region:

joe_zhou — Tue, 24 Jan 2023 12:13:24 GMT

And just adding that the access connector privilege has been granted as same as earlier steps indicated:

joe_zhou — Tue, 24 Jan 2023 12:35:42 GMT

Well. I've successfully created a metastore in east us region with similar settings. So guess something wrong in east asia.

Hubert-Dudek — Tue, 24 Jan 2023 18:51:33 GMT

joe_zhou — Thu, 26 Jan 2023 09:15:17 GMT

Thanks Hubert. But no luck. Still same error message.

Btw, the storage abfss link should be:

<container_name>@<storage_account_name>.dfs.core.windows.net/

instead of

<storage_account_name>@<container_name>.dfs.core.windows.net/

Andrew_Li — Tue, 14 Feb 2023 18:06:28 GMT

This is a bug, thanks for reporting it! Databricks engineers would address this soon.

Hubert-Dudek — Tue, 14 Feb 2023 19:41:41 GMT

I looked one more time and this region is not supported for UC https://docs.databricks.com/resources/supported-regions.html

Andrew_Li — Tue, 14 Feb 2023 20:12:58 GMT

Fix merged, will get rolled out in the next 2 weeks. In the meanwhile, you can create a metastore from databricks-cli.

joe_zhou — Wed, 15 Feb 2023 02:27:41 GMT

Thanks, deeply appreciated

joe_zhou — Wed, 15 Feb 2023 02:28:26 GMT

Thanks for keep looking, however that's the region for AWS 🙂

I've got a confirmation below from Andrew Li that the issue will be fixed soon.