Hi! We can configure a cluster single node with single user as service principal using this command:
databricks clusters create --json '
{
"cluster_name": "my-cluster",
"spark_version": "13.3.x-scala2.12",
"node_type_id": "Standard_DS3_v2",
"driver_node_type_id": "Standard_DS3_v2",
"single_user_name": "<CLIENTID>",
"data_security_mode": "SINGLE_USER",
"runtime_engine": "STANDARD",
"num_workers": 0,
"spark_conf": {
"spark.databricks.cluster.profile":"singleNode",
"spark.master":"local[*, 4]"
},
"custom_tags": {
"ResourceClass":"SingleNode"
}
}
'
But when we want to use this cluster in a notebook we get this error:
Single-user check failed: user '<reserved>@<reserved>.com' attempted to run a command on single-user cluster <CLUSTERID>, but the single user of this cluster is '<CLIENTID>'
We want to get a cluster with a service principal because we know that multiple people may use the cluster with the correct configuration. What we don't know is that it may be missing configuration. In Settings -> Identity and Access -> Service Principal -> Permissions we are managers and users.
If anyone knows we would appreciate it