Hi everyone!
I am configuring several projects using Databricks, and I have a question regarding permission management in Unity Catalog. Here's the situation:
Currently, I have two different Databricks resources in an Azure account, each with its respective workspace:
- Azure_Databricks_1 > my_workspace_1
- Azure_Databricks_2 > my_workspace_2
Additionally, I have configured and added a metastore called "my_metastore" to both workspaces, so that both can use the same Unity Catalog metastore.
Furthermore, each of the two workspaces has different users, meaning there are users common to both workspaces, and users who are not. To manage access more easily, I have created workspace-level groups, specifically a group called ādata_access.ā
In addition to that, each workspace has a catalog linked to the "my_metastore," and within those catalogs, the bronze, silver, and gold schemas are defined, so the structure looks something like this:
Azure_Databricks_1
my_workspace_1 > ādata_accessā group
my_catalog_1 > linked to āmy_metastoreā with the following schemas inside:
bronze
silver
gold
Azure_Databricks_2
my_workspace_2 > ādata_accessā group
my_catalog_2 > linked to āmy_metastoreā with the following schemas inside:
bronze
silver
gold
My question is: Is there any way to give users in the ādata_accessā group of workspace_1 permissions to create tables, volumes, etc., ONLY in the schemas associated with the āmy_catalog_1ā catalog?
The idea is that I, as an account-level administrator, create this catalog and schema structure in each workspace, as mentioned above, and then provide users in the ādata_accessā group (who can be different in each workspace) permissions to create tables and other objects but ONLY within that specific catalog, rather than in all catalogs defined within my Unity Catalog.
Important: Users in the ādata_accessā group for āmy_catalog_1ā should not have any access to the schemas and tables in the āmy_catalog_2ā catalog. Thatās why Iām trying to figure out how to restrict data access at the catalog level.
Any ideas on how I can do this?
P.S.: I have account admin and workspace admin permissions for all workspaces.
Thank you very much in advance.
Best regards.