Automate Unity Access management Process at Schema, Tables, Cluster and Job

[ameet9257]

Hi Team,

I’d like to automate the process of providing access to users and groups across:

• Schemas
• Tables
• Jobs
• Workflows
• Clusters

Currently, this is a manual, day-to-day process. Our goal is to implement an optimized, reliable solution.

Proposed approach (config + scripting):

• Use a config-file–based model (YAML/JSON) as the source of truth.
• A Python reconciler will read the configuration and update access in Unity Catalog and compute accordingly.
• Maintain the configuration in a Git repository to enable version control, change tracking, and reviews.

Request:

• Please share any prior experience with similar automation, including lessons learned, best practices, or recommended tooling.
• If feasible, let’s identify stakeholders and a suitable environment for a pilot.

#Unity #Access

[anshu_roy · Accepted solution]

Hello Amit,

You can automate Unity Catalog permissions management using the Databricks Terraform provider instead of ad‑hoc scripts. With the databricks_grants resource you can declaratively manage privileges at the catalog, schema, table, and table/view levels for users and groups, and keep everything under version control: https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/grants .
For end‑to‑end examples of managing Databricks and Unity Catalog with Terraform (including CI/CD), have a look at the official examples repo: https://github.com/databricks/terraform-databricks-examples.

Hope this helps. 

[saurabh18cs]

Hi @ameet9257  see if this psot can help you : https://www.linkedin.com/posts/ishashankshekhar_databricks-unitycatalog-datagovernance-activity-7334...