topic Re: Disk Type in Azure Databricks in Data Engineering

Disk Type in Azure Databricks

Matt_Johnston — Tue, 04 Jan 2022 16:04:19 GMT

Hi There,

How are the disks tiers determined in Azure Databricks? We are currently using a pool which is using Standard DS3 v2 Virtual Machines, all with Premium SSD disks. Is there a way to change the tier of the disks?

Thanks

Re: Disk Type in Azure Databricks

Anonymous — Wed, 05 Jan 2022 00:24:06 GMT

Hello, @Matthew Johnston - Thank you for your question, and welcome to the community! We'll give the members a chance to respond before we circle back to this. Thanks in advance for your patience.

Re: Disk Type in Azure Databricks

Matt_Johnston — Wed, 05 Jan 2022 09:14:41 GMT

Thanks Piper, i'll look forward to being part of the community.

Re: Disk Type in Azure Databricks

Atanu — Wed, 12 Jan 2022 04:10:21 GMT

I think we do not have option to change the disk type at this moment. but I would like to request you to raise a feature request through azure support if you are azure databricks user. if aws you can do the same from - https://docs.databricks.com/resources/ideas.html

Re: Disk Type in Azure Databricks

Matt_Johnston — Wed, 12 Jan 2022 14:56:34 GMT

Thanks Atanu,

It looks like this is automatically determined based on the VM instance in the pool. I will put in a feature request.

Thanks Again.