Can you create Clusters via a REST API?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-11-2021 11:20 AM
Yes, you can. See here: https://docs.databricks.com/dev-tools/api/latest/clusters.html
The JSON payload would look as follows:
{
"cluster_name": "my-cluster",
"spark_version": "7.3.x-scala2.12",
"node_type_id": "i3.xlarge",
"spark_conf": {
"spark.speculation": true
},
"aws_attributes": {
"availability": "SPOT",
"zone_id": "us-west-2a"
},
"num_workers": 25
}
Labels:
- Labels:
-
Cluster provisioning
-
Clusters
-
JSON
-
Rest API
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-08-2021 06:05 AM
One can create a Cluster(s) using CLuster API @ https://docs.databricks.com/dev-tools/api/latest/clusters.html#create
However, REST API 2.0 doesn't provide certain features like "Enable Table Access Control", which has been introduced after REST API 2.0. Given said that one can always enable those features using spark config:
spark.databricks.acl.sqlOnly true

