How to identify the mandatory fields of the create clusters API

[guangyi]

After several attempts I found some mandatory fields for cluster creation API: num_workers, spark_version, node_type_id. I’m not finding these fields directly against the API but via job cluster definition in the asset bundle yaml file.

I ask the ChatGPT the question and he gave almost the same answer and plus “cluster_name” field.

However, I cannot find the exact information on the API documentation either through “mandatory” or “required” keywords: https://docs.databricks.com/api/workspace/clusters/create.

[guangyi]

And also I found the `defaultValue` in the policy definition not working. Here I give the node_type_id allow list in the policy 

    "node_type_id": {
        "defaultValue": "Standard_D8s_v3",
        "type": "allowlist",
        "values": [
            "Standard_D8s_v3",
            "Standard_D16s_v3"
        ]
    },

But when I inherit this policy in the asset bundle and try to create job, it still tell me the the validation failed:

job_clusters:
        - job_cluster_key: my_job_cluster
          new_cluster:
            policy_id: xxxxxxxxxxxxxxxxxxx

cannot create job: INVALID_PARAMETER_VALUE: Unknown node type id