Unity catalog set up - unable to create table

AnthonyDang — Tue, 20 Dec 2022 16:09:48 GMT

Hi all, I've gone through the deployment guide to set up Unity catalog as outlined in https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started.

I tried creating a table once I had it set up with the below command.

CREATE TABLE main.default.department
(
  deptcode   INT,
  deptname  STRING,
  location  STRING
);
 
INSERT INTO main.default.department VALUES
  (10, 'FINANCE', 'EDINBURGH');

and the following error msg is returned

Operation failed: "Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.", 403, GET, https://storageaccount.dfs.core.windows.net/unitycatalog?upn=false&resource=filesystem&maxResults=5000&directory=directory AuthenticationFailed, "Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature. RequestId:

Things I have tried:

Cluster settings
1. single and shared cluster access modes
granted permissions/privileges on account admin, metastore, catalog, schema, storage credential, azure storage account

Please advise any ideas why or if there's anything I can try further. Thank you.

Re: Unity catalog set up - unable to create table

Avnish_Jain — Tue, 20 Dec 2022 16:47:01 GMT

Check to see if you have enabled the Hierarchical Namespace setting for the ADLS Gen 2.0 configuration.

Re: Unity catalog set up - unable to create table

AnthonyDang — Tue, 20 Dec 2022 17:07:27 GMT

Legend! This solved it for me. I kept checking permissioning issues but I missed a key step in setting up the storage account in the following guide: https://learn.microsoft.com/en-us/azure/storage/blobs/create-data-lake-storage-account.

topic Re: Unity catalog set up - unable to create table in Data Governance

Unity catalog set up - unable to create table

Re: Unity catalog set up - unable to create table

Re: Unity catalog set up - unable to create table