topic Issue setting metastore in GCP Databricks in Warehousing & Analytics

Issue setting metastore in GCP Databricks

manish05485 — Wed, 14 Feb 2024 14:40:43 GMT

While setting up metastore in GCP Databricks, I added the bucket name and then service account permissons as well. Still my catalog dont have base root location. This deters me from creating table in my catalog.

Root storage credential for metastore XXXXXX does not exist. Please contact your Databricks representative or consider updating the metastore with a valid storage credential https://docs.databricks.com/api- explorer/workspace/metastores/update

I followed this documentation, this root storage credential thing is nowhere mentioned in the documentation
https://docs.gcp.databricks.com/en/data-governance/unity-catalog/enable-workspaces.html#enable-workspace

Re: Issue setting metastore in GCP Databricks

Ayushi_Suthar — Thu, 15 Feb 2024 07:46:01 GMT

Hi @manish05485 , Good Day!

Error:Root storage credential for metastore XXXXXX does not exist. Please contact your Databricks representative or consider updating the metastore with a valid storage

Error states that the data access configuration for the metastore does not exist or don't have storage credential associated as well, for that we can list storage credentials and verify if the root storage credential exists we could associate that, if that doesn't exist please refer doc[1] to create one and that can be associated with the metastore. You could use Databricks CLI to perform these actions:

a. Get the storage credential Id by running the below command:
>> databricks unity-catalog list-storage-credentials

Document to refer : https://docs.gcp.databricks.com/en/archive/dev-tools/cli/unity-catalog-cli.html#list-available-storage-credentials

b. Create a file and save the storage credential as update-metastore.json
{
"storage_root_credential_id": "<storage-credential-id>"
}

c.Once the file has been created run the below command to associate the storage credential:

databricks unity-catalog metastores update --id 12a345b6-7890-1cd2-3456-e789f0a12b34 \
                                           --json-file update-metastore.json

Please refer to doc[2] for more details on updating metastore settings.

Doc[1]: https://docs.gcp.databricks.com/en/connect/unity-catalog/index.html#how-does-unity-catalog-connect-object-storage-to-databricks

Doc[2] : https://docs.gcp.databricks.com/en/archive/dev-tools/cli/unity-catalog-cli.html#update-a-metastores-settings

Please let me know if this helps and leave a like if this information is useful, followups are appreciated.
Kudos
Ayushi

Re: Issue setting metastore in GCP Databricks

manish05485 — Sat, 17 Feb 2024 10:11:41 GMT

@Retired_mod
Why is this not in the following documentation. Cant this thing be entirely setup via UI without going to api routes, because business leaders prefer setting up things via UI forms etc , instead of technical nitty gritty.
https://docs.gcp.databricks.com/en/data-governance/unity-catalog/enable-workspaces.html#enable-workspace

Additionally is there step by step demo of this?