topic Re: Getting error "Serverless Generic Compute Cluster Not Supported For External Creators." in Data Engineering

Getting error "Serverless Generic Compute Cluster Not Supported For External Creators."

tonyd — Thu, 26 Sep 2024 10:10:20 GMT

Getting the above mentioned error while creating serverless compute.
this is the request

curl --location 'https://adb.azuredatabricks.net/api/2.0/clusters/create' \

--header 'Content-Type: application/json' \

--header 'Authorization: ••••••' \

--data '{

"cluster_name":"server-less-cluster-postman",

"spark_version":"11.3.x-scala2.12",

"node_type_id":"i3.large",

"enable_serverless_compute":true,

"autoscale":{

"min_workers":0,

"max_workers":2

}

}'

Response -

{

"error_code": "INVALID_PARAMETER_VALUE",

"message": "Serverless Generic Compute Cluster Not Supported For External Creators.",

"details": [

{

"@type": "type.googleapis.com/google.rpc.ErrorInfo",

"reason": "CM_API_ERROR_SOURCE_CALLER_ERROR",

"domain": ""

}

]

}

Re: Getting error "Serverless Generic Compute Cluster Not Supported For External Creators."

saikumar246 — Tue, 01 Oct 2024 07:47:16 GMT

Hi @tonyd Thank you for reaching out to the Databricks Community.

You are trying to create a Serverless Generic Compute Cluster which is not supported. You cannot create a Serverless compute Cluster.

As per the below link, if you observe, there is no parameter like "enable_serverless_compute". you cannot use this in the Cluster create API

https://docs.databricks.com/api/workspace/clusters/create

But you can create a Serverless SQL Warehouse where you can also use the parameter "enable_serverless_compute". You can observe this param in the below link which is Warehouse create API,

https://docs.databricks.com/api/workspace/warehouses/create

Please leave a like if it is helpful. Follow-ups are appreciated.

Kudos,

Sai Kumar