topic Re: unity catalog databricks_metastore terraform - not authorized in Data Governance

unity catalog databricks_metastore terraform - not authorized

amitca71 — Wed, 07 Sep 2022 08:38:41 GMT

i created unity catalog using terraform on AWS, and able to create manualy a meta store with same user.

when trying to create metsastore from terraform, i get unauthorized error:

Error: cannot create metastore: Unauthorized

│

│ with module.unity_catalog_metastore.databricks_metastore.this,

│ on modules/uc_metastore/main.tf line 1, in resource "databricks_metastore" "this":

│ 1: resource "databricks_metastore" "this" {

provider:

databricks = {

source = "databricks/databricks"

version = "~>1.2.1"

}

i use the mws provider with user and password:

provider "databricks" {

alias = "mws"

host = "https://accounts.cloud.databricks.com"

account_id = var.databricks_account_id

username = var.databricks_username

password = var.databricks_password

}

my user is account admin (otherwise i wouldnt be able to create the catalog itself..)

the resource configuration:

resource "databricks_metastore" "this" {

name = "primary"

storage_root = "s3://${var.unity_metastore_bucket}/metastore"

owner = var.unity_admin_group

force_destroy = true

}

Any idea?

Thanks,

Amit

Anonymous — Tue, 11 Oct 2022 14:23:33 GMT

Hello @Amit Cahanovich ,

Few things to note

Unity catalogue APIs are currently exposed via the workspace endpoint, not the account endpoint. When you create via UI it uses account-level API but it's still not exposed to the public.

amitca71 — Tue, 11 Oct 2022 16:47:02 GMT

thanks 🙂