AWS Databricks Pay-as-you-Go

[DataDNA]

Hi Team,

We are currently using AWS cloud service for our AI/ML Project. We wanted to use Databricks based GPU service for model training purposes. We do not find a Pay-as-you-go option in marketplace for this purposes.

Can someone help me on this !

Thanks in advance.

Regards

Vijay

[-werners- · Accepted solution]

it is just a Databricks subscription. When you have subscribed, you can use a GPU based cluster for your ML. There should be a pay-as-you-go version of Databricks, but there is no separate offering for GPU based clusters, it is included.

[DataDNA]

I am attaching the screenshot here for reference. I cannot see a Pay as you go option at all. It is only asking for a monthly contract. Kindly help !

[-werners-]

https://databricks.com/product/aws-pricing

I guess you try to roll out something else?

[DataDNA]

I went to AWS marketplace & selected 'Databricks' from it. This is the screenshot of databricks via AWS Marketplace. Is there any other way to use AWS Databricks apart from this so that I can get the GPU Pay-as-you-go option?

[-werners-]

Maybe you have a special AWS contract/agreement?

[DataDNA]

Nope . We do not have anything like that . We in fact prefer to go with Pay-as-you-go as its easier to manage our resources & pricing.

Any pointers on this ? or may be can you direct us to enable it ?

[-werners-]

We are exclusively on Azure so can't help you with that.

But there are people in here who do work on AWS, so they can probably help you out.

[DataDNA]

Can you tag them so that I can follow up with them parallely

[jose_gonzalez]

Hi @Vijayakeerthi Jayakumar​ ,

When you try to create a cluster, do you see the "ML" runtime? Here is a screenshot of how to select the ML databricks runtime and how it should look like the GPU vs CPU instance type