topic databricks single user cluster is not able to assign service principals in Data Engineering

databricks single user cluster is not able to assign service principals

17780 — Wed, 10 May 2023 04:34:51 GMT

I want to set the databricks cluster Access mode to single user and assign the service principal account to the user.

In other words, after creating a single mode cluster, how can I access only servcie principals?

Re: databricks single user cluster is not able to assign service principals

17780 — Wed, 10 May 2023 04:39:16 GMT

Cluster Type is All-purpose Compute

Re: databricks single user cluster is not able to assign service principals

AFox — Tue, 05 Dec 2023 22:44:00 GMT

@17780 Did you ever figure this out? I am trying to do the same.

Re: databricks single user cluster is not able to assign service principals

Zpakerman — Sat, 09 Dec 2023 00:47:36 GMT

Sure thing! So, if you're looking to set up your data block cluster access mode to a single user and want that user to be a service principal account, you've got a couple of steps ahead. First, create your single-mode cluster. Once that's done, you'll need to assign the service principal account to it. This involves configuring the necessary permissions and access rights for that service principal. After the setup, you should be able to access the cluster using only the service principal account you've designated. It's all about fine-tuning those permissions to ensure that only the right folks (or, in this case, service principals) can get in. Double-check your configurations, and you should be good to go!

Best regards, Zpakerman

Re: databricks single user cluster is not able to assign service principals

SathyaVasu — Thu, 04 Apr 2024 16:32:47 GMT

Below solution worked for me!!
It is not possible to update single user via UI
But you can update the service principal as the signle user via databricks cli.
1. install databricks cli

2. run command databricks configure

3. run command:
# Execute clusters edit Command to Set Service Principal as Single User
databricks clusters edit <cluster id> <spark version number>--cluster-name "<cluster name>" --data-security-mode SINGLE_USER --single-user-name <client id of the service principal> --num-workers 1 --node-type-id <node type> --no-wait

Re: databricks single user cluster is not able to assign service principals

Pat_IronBridges — Tue, 29 Oct 2024 15:59:18 GMT

So, here is an alternative to either the UI (doesn't work actually; not possible) or the CLI. Use the Databricks API.

endpoint_change = f"{databricksURL}/api/2.1/clusters/edit" # change single owner

payload_change = {

"cluster_id": cluster_id

,"cluster_name": cluster_name

,"single_user_name": new_owner # serv principal user id

,"num_workers": 1

,"spark_version": "14.3.x-cpu-ml-scala2.12" # required; set to what you want

,"node_type_id": "r6id.xlarge" #required; set to what you want

,"data_security_mode": "SINGLE_USER"

}

response = requests.post(

endpoint_change,

headers=headers,

json=payload_change

)

#if you have init scripts running, they should be included in the the json payload as well. (doesn't work setting them in the UI).

# also be sure the service principal has access to the init script location