topic Re: Encountering an error while setting up a single-node cluster on top of aws in Data Engineering

Encountering an error while setting up a single-node cluster on top of aws

devpavan — Tue, 21 Oct 2025 16:02:25 GMT

Hi Team,

I'm trying to create a single-node cluster in Databricks on AWS, but I'm encountering an error. Could you please assist me with this?

{
  "reason": {
    "code": "INVALID_ARGUMENT",
    "type": "CLIENT_ERROR",
    "parameters": {
      "databricks_error_message": "The VM launch request to AWS failed, please check your configuration. [details] InvalidParameterCombination: The specified instance type is not eligible for Free Tier. For a list of Free Tier instance types, run 'describe-instance-types' with the filter 'free-tier-eligible=true'. (Service: AmazonEC2; Status Code: 400; Error Code: InvalidParameterCombination; Request ID: 550e7aa6-ced4-427f-a31d-7d00af509523; Proxy: null)(OnDemand)",
      "instance_id": "failed-399450b2-55fe-4898-8",
      "aws_api_error_code": "InvalidParameterCombination",
      "aws_error_message": "The specified instance type is not eligible for Free Tier. For a list of Free Tier instance types, run 'describe-instance-types' with the filter 'free-tier-eligible=true'. (Service: AmazonEC2; Status Code: 400; Error Code: InvalidParameterCombination; Request ID: 550e7aa6-ced4-427f-a31d-7d00af509523; Proxy: null)(OnDemand)"
    }
  },
  "add_node_failure_details": {
    "failure_count": 1,
    "resource_type": "container",
    "will_retry": false
  }
}

Re: Encountering an error while setting up a single-node cluster on top of aws

dkushari — Tue, 21 Oct 2025 18:21:44 GMT

Hi @devpavan - what node type are you using to create the cluster? Can you share the details of the configuration? Ty!

Re: Encountering an error while setting up a single-node cluster on top of aws

nayan_wylde — Tue, 21 Oct 2025 18:25:42 GMT

@devpavan Are you using API or terraform to create. Can you please share the json config that you are passing?

Re: Encountering an error while setting up a single-node cluster on top of aws

devpavan — Wed, 22 Oct 2025 10:34:25 GMT

Hi @dkushari ,

i am creating a single node cluster on top of aws could you please verify the below details here

{

"data_security_mode": "DATA_SECURITY_MODE_AUTO",

"cluster_name": "aws-demo",

"kind": "CLASSIC_PREVIEW",

"aws_attributes": {

"zone_id": "auto"

"runtime_engine": "PHOTON",

"spark_version": "17.3.x-scala2.13",

"node_type_id": "m5d.large",

"autotermination_minutes": 30,

"enable_elastic_disk": true,

"is_single_node": true,

"cluster_id": "1022-103026-uijw8ory"

}

Re: Encountering an error while setting up a single-node cluster on top of aws

devpavan — Wed, 22 Oct 2025 10:36:06 GMT

Hi @nayan_wylde ,
could you please verify the below json configuration

{

"data_security_mode": "DATA_SECURITY_MODE_AUTO",

"cluster_name": "aws-demo",

"kind": "CLASSIC_PREVIEW",

"aws_attributes": {

"zone_id": "auto"

"runtime_engine": "PHOTON",

"spark_version": "17.3.x-scala2.13",

"node_type_id": "m5d.large",

"autotermination_minutes": 30,

"enable_elastic_disk": true,

"is_single_node": true,

"cluster_id": "1022-103026-uijw8ory"

}

Re: Encountering an error while setting up a single-node cluster on top of aws

szymon_dybczak — Wed, 22 Oct 2025 11:10:18 GMT

Hi @devpavan ,

The error suggest that you're using Free Tier - and specified instance you're trying to create is not eligable for Free Tier.
So, to me it looks like you have Free Free/Trial AWS Account and probably hit this limitation/

So, you can do what they suggest. Run below command and check what types of VMs are elgible in Free Tier. Then try to create compute that is aligned with that.

run 'describe-instance-types' with the filter 'free-tier-eligible=true'

Re: Encountering an error while setting up a single-node cluster on top of aws

devpavan — Wed, 22 Oct 2025 14:30:19 GMT

Hi @szymon_dybczak ,
thanks for your help!

It turns out the AWS free-tier instance types are not supported by the Data bricks account I'm using. I’ve switched to using AWS paid services, and everything is working fine now.

Really appreciate the valuable information — it helped me resolve the issue!

Re: Encountering an error while setting up a single-node cluster on top of aws

szymon_dybczak — Wed, 22 Oct 2025 14:40:18 GMT

Hi @devpavan ,

No problem, that was exactly what I thought 🙂 If this answer was helpful to you please consider marking it as a solution to this topic. This way we help others with similar problem find correct answer faster 😉