Encountering an error while setting up a single-node cluster on top of aws

[devpavan]

Hi Team,

I'm trying to create a single-node cluster in Databricks on AWS, but I'm encountering an error. Could you please assist me with this?

{
  "reason": {
    "code": "INVALID_ARGUMENT",
    "type": "CLIENT_ERROR",
    "parameters": {
      "databricks_error_message": "The VM launch request to AWS failed, please check your configuration. [details] InvalidParameterCombination: The specified instance type is not eligible for Free Tier. For a list of Free Tier instance types, run 'describe-instance-types' with the filter 'free-tier-eligible=true'. (Service: AmazonEC2; Status Code: 400; Error Code: InvalidParameterCombination; Request ID: 550e7aa6-ced4-427f-a31d-7d00af509523; Proxy: null)(OnDemand)",
      "instance_id": "failed-399450b2-55fe-4898-8",
      "aws_api_error_code": "InvalidParameterCombination",
      "aws_error_message": "The specified instance type is not eligible for Free Tier. For a list of Free Tier instance types, run 'describe-instance-types' with the filter 'free-tier-eligible=true'. (Service: AmazonEC2; Status Code: 400; Error Code: InvalidParameterCombination; Request ID: 550e7aa6-ced4-427f-a31d-7d00af509523; Proxy: null)(OnDemand)"
    }
  },
  "add_node_failure_details": {
    "failure_count": 1,
    "resource_type": "container",
    "will_retry": false
  }
}

[dkushari]

Hi @devpavan - what node type are you using to create the cluster? Can you share the details of the configuration? Ty!

[devpavan]

Hi @dkushari ,

i am creating a single node cluster on top of aws could you please verify the below details here 

{

  "data_security_mode": "DATA_SECURITY_MODE_AUTO",

  "cluster_name": "aws-demo",

  "kind": "CLASSIC_PREVIEW",

  "aws_attributes": {

    "zone_id": "auto"

  },

  "runtime_engine": "PHOTON",

  "spark_version": "17.3.x-scala2.13",

  "node_type_id": "m5d.large",

  "autotermination_minutes": 30,

  "enable_elastic_disk": true,

  "is_single_node": true,

  "cluster_id": "1022-103026-uijw8ory"

}

[nayan_wylde]

@devpavan Are you using API or terraform to create. Can you please share the json config that you are passing?

[devpavan]

Hi @nayan_wylde ,
could you please verify the below json configuration 

{

  "data_security_mode": "DATA_SECURITY_MODE_AUTO",

  "cluster_name": "aws-demo",

  "kind": "CLASSIC_PREVIEW",

  "aws_attributes": {

    "zone_id": "auto"

  },

  "runtime_engine": "PHOTON",

  "spark_version": "17.3.x-scala2.13",

  "node_type_id": "m5d.large",

  "autotermination_minutes": 30,

  "enable_elastic_disk": true,

  "is_single_node": true,

  "cluster_id": "1022-103026-uijw8ory"

}

[szymon_dybczak]

Hi @devpavan ,

The error suggest that you're using Free Tier - and specified instance you're  trying to create is not eligable for Free Tier. 
So, to me it looks like you have Free Free/Trial AWS Account and probably hit this limitation/

So, you can do what they suggest. Run below command and check what types of VMs are elgible in Free Tier. Then try to create compute that is aligned with that.

run 'describe-instance-types' with the filter 'free-tier-eligible=true'

[devpavan · Accepted solution]

Hi @szymon_dybczak ,
thanks for your help!

It turns out the AWS free-tier instance types are not supported by the Data bricks account I'm using. I’ve switched to using AWS paid services, and everything is working fine now.

Really appreciate the valuable information — it helped me resolve the issue!

[szymon_dybczak · Accepted solution]

Hi @devpavan ,

No problem, that was exactly what I thought 🙂 If this answer was helpful to you please consider marking it as a solution to this topic. This way we help others with similar problem find correct answer faster 😉