Hi everyone!
I am configuring several projects using Databricks, and I have a question regarding permission management in Unity Catalog. Here's the situation:
Currently, I have two different Databricks resources in an Azure account, each with its respective workspace:
- Azure_Databricks_1 > my_workspace_1
- Azure_Databricks_2 > my_workspace_2
Additionally, I have configured and added a metastore called "my_metastore" to both workspaces, so that both can use the same Unity Catalog metastore.
Furthermore, each of the two workspaces has different users, meaning there are users common to both workspaces, and users who are not. To manage access more easily, I have created workspace-level groups, specifically a group called โdata_access.โ
In addition to that, each workspace has a catalog linked to the "my_metastore," and within those catalogs, the bronze, silver, and gold schemas are defined, so the structure looks something like this:
Azure_Databricks_1
my_workspace_1 > โdata_accessโ group
my_catalog_1 > linked to โmy_metastoreโ with the following schemas inside:
bronze
silver
gold
Azure_Databricks_2
my_workspace_2 > โdata_accessโ group
my_catalog_2 > linked to โmy_metastoreโ with the following schemas inside:
bronze
silver
gold
My question is: Is there any way to give users in the โdata_accessโ group of workspace_1 permissions to create tables, volumes, etc., ONLY in the schemas associated with the โmy_catalog_1โ catalog?
The idea is that I, as an account-level administrator, create this catalog and schema structure in each workspace, as mentioned above, and then provide users in the โdata_accessโ group (who can be different in each workspace) permissions to create tables and other objects but ONLY within that specific catalog, rather than in all catalogs defined within my Unity Catalog.
Important: Users in the โdata_accessโ group for โmy_catalog_1โ should not have any access to the schemas and tables in the โmy_catalog_2โ catalog. Thatโs why Iโm trying to figure out how to restrict data access at the catalog level.
Any ideas on how I can do this?
P.S.: I have account admin and workspace admin permissions for all workspaces.
Thank you very much in advance.
Best regards.