Getting error "Serverless Generic Compute Cluster Not Supported For External Creators."

tonyd
New Contributor II

‎09-26-2024 03:10 AM

Getting the above mentioned error while creating serverless compute. 
this is the request 

--header 'Content-Type: application/json' \
--header 'Authorization: ••••••' \
--data '{
"cluster_name":"server-less-cluster-postman",
"spark_version":"11.3.x-scala2.12",
"node_type_id":"i3.large",
"enable_serverless_compute":true,
"autoscale":{
"min_workers":0,
"max_workers":2
}
}'

Response - 


{
"error_code": "INVALID_PARAMETER_VALUE",
"message": "Serverless Generic Compute Cluster Not Supported For External Creators.",
"details": [
{
"@type": "type.googleapis.com/google.rpc.ErrorInfo",
"reason": "CM_API_ERROR_SOURCE_CALLER_ERROR",
"domain": ""
}
]
}
0 Kudos

saikumar246
Databricks Employee
Databricks Employee

‎10-01-2024 12:47 AM

Hi @tonyd Thank you for reaching out to the Databricks Community.

You are trying to create a Serverless Generic Compute Cluster which is not supported. You cannot create a Serverless compute Cluster.

As per the below link, if you observe, there is no parameter like "enable_serverless_compute". you cannot use this in the Cluster create API

https://docs.databricks.com/api/workspace/clusters/create

But you can create a Serverless SQL Warehouse where you can also use the parameter "enable_serverless_compute". You can observe this param in the below link which is Warehouse create API,

https://docs.databricks.com/api/workspace/warehouses/create

Please leave a like if it is helpful. Follow-ups are appreciated.

Kudos,

Sai Kumar

0 Kudos