cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Programmatically activate groups in account

Sven_Relijveld
New Contributor

Hi,

I am currently trying to use the Accounts SDK to add External groups from Entra ID to functional groups within Databricks. I expect thousands of groups in Entra and I want to add these groups programmatically (for example) to a group in Databricks that has access to an Endpoint, or a Dashboard or give them consumer access by default. 

Example: thousand of Entra groups called 'projectgroup_projectcode_external_managed_automatic' into a non-Entra databricks group 'Databricks Vector Search Readers'. This way I can manage the permissions of functional groups within databricks and the organizational groups and their members are managed in Entra, outside my scope by another team.

Our Entra groups have a very standardized structure, with which i can filter it down to the correct set of groups
List group details. | Account Groups API | REST API reference | Azure Databricks

filter=displayName co "foo" and displayName co "bar"

Now I noticed that untill the groups are activated, I cannot find them with the API or SDK. I can find them through the UI however with Automatic Identity Management, and i notice this is powered by GraphQL, probably directly querying the Microsoft Graph API.

How can I programmatically 'activate' these External Entra groups within databricks account, such that i can manage them from there?

1 ACCEPTED SOLUTION

Accepted Solutions

BigRoux
Databricks Employee
Databricks Employee

Hey @Sven_Relijveld , I did some digging/research and here is a summary of what I uncovered:

 

 

  • There is currently no public Databricks Accounts API that lets you pre-activate or bulk-import Entra groups directly by object ID or filter. JIT provisioning via assignment is the only way for AIM.
  • You can automate bulk initial activation by scripting permission/group/resource assignments in the UI or via account/workspace assignment APIs, if your environment has access.
  • For direct Entra-to-Databricks group sync and management, configure a SCIM connector and manage assignments in Entra.
  • After activation, all group operations, including permissions, access assignment, and consumption in group-based policies/workflows, can be performed programmatically via the Account Groups API, SDKs, or the Terraform provider.

 

Let me know if this is helpful.

Cheers, Louis.

 

View solution in original post

1 REPLY 1

BigRoux
Databricks Employee
Databricks Employee

Hey @Sven_Relijveld , I did some digging/research and here is a summary of what I uncovered:

 

 

  • There is currently no public Databricks Accounts API that lets you pre-activate or bulk-import Entra groups directly by object ID or filter. JIT provisioning via assignment is the only way for AIM.
  • You can automate bulk initial activation by scripting permission/group/resource assignments in the UI or via account/workspace assignment APIs, if your environment has access.
  • For direct Entra-to-Databricks group sync and management, configure a SCIM connector and manage assignments in Entra.
  • After activation, all group operations, including permissions, access assignment, and consumption in group-based policies/workflows, can be performed programmatically via the Account Groups API, SDKs, or the Terraform provider.

 

Let me know if this is helpful.

Cheers, Louis.

 

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now