Here is the command to create cluster using databricks-cli
databricks clusters create --json-file create-cluster.json
create-cluster.json
{
"cluster_name": "my-cluster",
"spark_version": "7.3.x-scala2.12",
"node_type_id": "i3.xlarge",
"spark_conf": {
"spark.speculation": true
},
"aws_attributes": {
"availability": "SPOT",
"zone_id": "us-west-2a"
},
"num_workers": 25
}
Console output:
{
"cluster_id": "1234-567890-batch123"
}
Ref : https://docs.databricks.com/dev-tools/cli/clusters-cli.html