Can you create Clusters via a REST API?

User16856693631
Databricks Employee
Databricks Employee

‎06-11-2021 11:20 AM

Yes, you can. See here: https://docs.databricks.com/dev-tools/api/latest/clusters.html

The JSON payload would look as follows:

{
  "cluster_name": "my-cluster",
  "spark_version": "7.3.x-scala2.12",
  "node_type_id": "i3.xlarge",
  "spark_conf": {
    "spark.speculation": true
  },
  "aws_attributes": {
    "availability": "SPOT",
    "zone_id": "us-west-2a"
  },
  "num_workers": 25
}

Labels:
0 Kudos

ManishPatil
New Contributor II

‎09-08-2021 06:05 AM

One can create a Cluster(s) using CLuster API @ https://docs.databricks.com/dev-tools/api/latest/clusters.html#create

However, REST API 2.0 doesn't provide certain features like "Enable Table Access Control", which has been introduced after REST API 2.0. Given said that one can always enable those features using spark config:

spark.databricks.acl.sqlOnly true

Ref: https://docs.databricks.com/security/access-control/table-acls/table-acl.html#sql-only-table-access-...

0 Kudos