topic Re: Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform? in Data Governance

Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform?

fuselessmatt — Wed, 18 Jan 2023 16:08:53 GMT

We have been successfully managing access for our unity catalogs using the databricks_grant resources in Terraform. Now we want to enable the Rudderstack integration for Databricks, but that does not support unity catalog and instead put files inside the hive_metastore catalog (external metastore?). From the UI I can grant things like READ_METADATA and CREATE_NAMED_FUNCTION, but I can't find any resources that include these. Is this simply not possible?

Update: Rudderstack now release support for Unity Catalog, so we no longer have any use for this.

Re: Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform?

Anonymous — Mon, 10 Apr 2023 15:13:58 GMT

@Mattias P :

Unfortunately, it is not currently possible to manage access to the Hive Metastore catalog (or other external metastores) using the databricks_grant resource in Terraform. This is because the databricks_grant resource is specifically designed to manage access to Databricks resources within the Databricks workspace, and external metastores are not within the workspace.

However, you may be able to manage access to the Hive Metastore catalog using a different method, such as creating custom roles and permissions in your Hive Metastore service, or using a separate tool to manage access to the metastore.

Alternatively, you could consider using Databricks as the metastore for Rudderstack instead of using an external metastore. This would allow you to continue using the databricks_grant resource in Terraform to manage access to the Rudderstack integration in Databricks.

Re: Is it possible to manage access for legacy catalogs (hive_metastore) in Terraform?

stropa — Wed, 04 Oct 2023 06:02:36 GMT

Actually, it is possible to manage permissions for the legacy catalog with databricks_sql_permissions Resource:
https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/sql_permissions#argument-reference