Automate Unity Access management Process at Schema, Tables, Cluster and Job

ameet9257
Contributor

Hi Team,

I’d like to automate the process of providing access to users and groups across:

  • Schemas
  • Tables
  • Jobs
  • Workflows
  • Clusters

Currently, this is a manual, day-to-day process. Our goal is to implement an optimized, reliable solution.

Proposed approach (config + scripting):

  • Use a config-file–based model (YAML/JSON) as the source of truth.
  • A Python reconciler will read the configuration and update access in Unity Catalog and compute accordingly.
  • Maintain the configuration in a Git repository to enable version control, change tracking, and reviews.

Request:

  • Please share any prior experience with similar automation, including lessons learned, best practices, or recommended tooling.
  • If feasible, let’s identify stakeholders and a suitable environment for a pilot.

#Unity #Access

Amit Prajapati

anshu_roy
Databricks Employee
Databricks Employee

Hello Amit,

You can automate Unity Catalog permissions management using the Databricks Terraform provider instead of ad‑hoc scripts. With the databricks_grants resource you can declaratively manage privileges at the catalog, schema, table, and table/view levels for users and groups, and keep everything under version control: https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/grants .
For end‑to‑end examples of managing Databricks and Unity Catalog with Terraform (including CI/CD), have a look at the official examples repo: https://github.com/databricks/terraform-databricks-examples.

Hope this helps. 

View solution in original post

saurabh18cs
Honored Contributor III