topic Re: Unity catalog - How do you modify groups properly ? in Data Engineering

Unity catalog - How do you modify groups properly ?

yvuignie — Wed, 02 Nov 2022 13:22:52 GMT

Hello,

What is the best practice to modify/delete/recreate groups properly ?

In order to rename a group, the only mean was to delete/recreate. But after deletion in the account console, the permissions granted to the deleted groups in the tables were in a bad state, i.e it was then not possible to revoke the permissions. There was an error "Could not find principal with name ...". The only way to restore a proper state was to drop the catalog.

Re: Unity catalog - How do you modify groups properly ?

yvuignie — Thu, 03 Nov 2022 08:16:19 GMT

Hi @Debayan Mukherjee ,

Thank you for your answer, but no it does not help. The problem is that if a group is deleted, the grants on the tables/schemas/catalogs on this group are in a bad state. There is no way to revoke the grants, because it cant find the group that was deleted with this error "Could not find principal with name ...". Only way to recover a good state is to delete the table/schema/catalog, and this is not good solution.

It's as if the grant on the table is assigned an id, and this id is not found anymore. The delete group action should not be possible if grants are still referencing the group, or the delete group action should remove the grants.

Re: Unity catalog - How do you modify groups properly ?

karthik_p — Thu, 03 Nov 2022 14:57:25 GMT

@Yannick Vuignier why do you want to delete whole group, objective of group creation is have multiple users in that group and assign permissions to whole group. if a user is removed from that group, remaining users will have all permissions as it is. as @Debayan Mukherjee mentioned you can go with that approach please

Re: Unity catalog - How do you modify groups properly ?

yvuignie — Thu, 03 Nov 2022 15:10:22 GMT

The problem is to rename a group, the only way is to delete and recreate. But we have to make sure to remove the grants before deleting the groups, otherwise the grants will be in a bad state and it is then not possible to revoke them.

Re: Unity catalog - How do you modify groups properly ?

karthik_p — Thu, 03 Nov 2022 17:20:49 GMT

@Yannick Vuignier yes got you, best way is revoke permission related to catalog/tables and then delete groups, as permissions are inherited from catalog - schema - table please @Debayan Mukherjee posted link has good information which can be used

Re: Unity catalog - How do you modify groups properly ?

yvuignie — Fri, 04 Nov 2022 07:51:20 GMT

@karthik p Thank you for your answer, I wish that the delete group action should not be possible if grants are still referencing the group, or the delete group action should remove the grants.

Re: Unity catalog - How do you modify groups properly ?

Anonymous — Sun, 06 Nov 2022 08:29:16 GMT

Hi @Yannick Vuignier

Hope all is well!

Just wanted to check in if you were able to resolve your issue, and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!

Re: Unity catalog - How do you modify groups properly ?

yvuignie — Wed, 16 Nov 2022 08:28:47 GMT

After checking with Microsoft support: "this issue is happening only temporarily due to the browser cache and the issue is resolved after a few mins and we don't see that after the browser cache has been updated. This could be expected with the eventual consistency."

Re: Unity catalog - How do you modify groups properly ?

156948 — Wed, 05 Apr 2023 15:24:24 GMT

Hello,

I would like to reopen this thread, as I have exactly the same issue

I also tried to rename a group name and it makes the catalog permissions to be in a bad state. I am not able to revoke access to this group using the Databricks UI nor REST API. I also tried to recreate the group with the same name, but it doesn't help

The issue is not related to the browser cache, because I use Terraform/REST API

Is there any way to remove this permission without recreating whole catalog?

Re: Unity catalog - How do you modify groups properly ?

Debayan — Thu, 03 Nov 2022 07:01:40 GMT

Hi @Yannick Vuignier , Securable objects in Unity Catalog are hierarchical and privileges are inherited downward. You can assign and revoke permissions using Data Explorer, SQL commands, or REST APIs.

https://docs.databricks.com/data-governance/unity-catalog/manage-privileges/index.html

Please let us know if this does not help.

Re: Unity catalog - How do you modify groups properly ?

RobinK — Thu, 15 Feb 2024 13:04:12 GMT

Hello,

I have exactly the same issue - I am also using terraform.

I deleted a group and the catalog permissions are in bad state. I am not able to revoke access to this group using the Databricks UI nor REST API. I also tried to recreate the group with the same name, but it doesn't help

How can I fix the permissions?

Re: Unity catalog - How do you modify groups properly ?

RobinK — Fri, 16 Feb 2024 06:30:08 GMT

Update: If you know the Id of the deleted group, you can recreate it with the Databricks Rest API: https://docs.databricks.com/api/account/accountgroups/create (you can set name and id in the request)

Re: Unity catalog - How do you modify groups properly ?

loic — Tue, 09 Jul 2024 15:21:15 GMT

Hello RobinK,

I know the Id of the deleted group but I don't manage to re-create the group with the same Id.
The API you sent the link can indeed take an "Id", but this one is ignored..
Do you have an idea why?