topic Override default Personal Compute policy using terraform / disable Personal Compute policy in Administration & Architecture

Override default Personal Compute policy using terraform / disable Personal Compute policy

ossinova — Fri, 23 Feb 2024 11:44:13 GMT

I want to programmatically do some adjustments to the default personal compute resource or preferably create my own custom one based on the same configuration or policy family (in which all users can gain access to) when deploying a new workspace using terraform. I know an account admin can enable Manage the Personal Compute policy - Azure Databricks | Microsoft Learn at an account level although I am uncertain if this can be applied for other policies too (for instance the custom one) so that the default is disabled and the custom one takes over.

Is there a way to override the defualt personal compute policy? I need the following to be overridden:

"autotermination_minutes": {
"type": "fixed",
"value": 30
}

This auto termination should be the default for all personal compute clusters in the workspace. Is there a way to make this work without having to manually adjust it post-deployment?

Re: Override default Personal Compute policy using terraform / disable Personal Compute policy

feiyun0112 — Fri, 23 Feb 2024 12:32:57 GMT

use api to create new cluster, set autotermination_minutes parameter

https://docs.databricks.com/api/workspace/clusters/create#autotermination_minutes

Re: Override default Personal Compute policy using terraform / disable Personal Compute policy

ossinova — Fri, 23 Feb 2024 12:44:54 GMT

I am aware of the API. However, that is out of scope of the question as I want to configure a policy upon workspace creation using Terraform as opposed to creating a cluster. The policy should override the default configuration of the current default one shipped with databricks.

Re: Override default Personal Compute policy using terraform / disable Personal Compute policy

jsimonovic — Tue, 30 Apr 2024 14:33:03 GMT

Hi, I think this doc might be useful: Override default Personal Compute policy using ter... - Databricks - 61695, basically is an override process by creating a databricks_cluster_policy resource:

locals { personal_vm_override = { "autotermination_minutes" : { "type" : "fixed", "value" : 220, "hidden" : true }, "custom_tags.Team" : { "type" : "fixed", "value" : var.team } } } resource "databricks_cluster_policy" "personal_vm" { policy_family_id = "personal-vm" policy_family_definition_overrides = jsonencode(personal_vm_override) name = "Personal Compute" }

Re: Override default Personal Compute policy using terraform / disable Personal Compute policy

Clowa — Thu, 24 Oct 2024 08:30:40 GMT

Only way I got it working was by importing the pre-existing policy into terraform and do an overwrite as already mentioned by @jsimonovic . The full code example looks like this:

import { id = "001BF0AC280610B4" # Polcy ID of the pre-existing personal compute policy to = databricks_cluster_policy.personal_vm } resource "databricks_cluster_policy" "personal_vm" { name = "Personal Compute" policy_family_id = "personal-vm" policy_family_definition_overrides = jsonencode({ autotermination_minutes = { type = "fixed", value = 30, } }) }