topic Is there a way to avoid using EBS drives on workers with local NVMe SSD? in Data Engineering https://community.databricks.com/t5/data-engineering/is-there-a-way-to-avoid-using-ebs-drives-on-workers-with-local/m-p/14118#M8667 <P>The Databricks on AWS docs <A href="https://docs.databricks.com/clusters/configure.html#default-ebs-volumes-1" alt="https://docs.databricks.com/clusters/configure.html#default-ebs-volumes-1" target="_blank">claim</A> that 30G + 150G EBS drives are mounter to every node by default. But if I use instance type like r5d.2xlarge, it already has local disk so I want to avoid mounting the 150G EBS drive to it. Is there a way to do it?</P><P></P><P>We usually use instance pools for our jobs, and I tried to create one with disk_spec.disk_count = 0, but it didn't work. The 150G has still been mounted to the machine.</P> Mon, 11 Jul 2022 07:13:24 GMT ivanychev 2022-07-11T07:13:24Z Is there a way to avoid using EBS drives on workers with local NVMe SSD? https://community.databricks.com/t5/data-engineering/is-there-a-way-to-avoid-using-ebs-drives-on-workers-with-local/m-p/14118#M8667 <P>The Databricks on AWS docs <A href="https://docs.databricks.com/clusters/configure.html#default-ebs-volumes-1" alt="https://docs.databricks.com/clusters/configure.html#default-ebs-volumes-1" target="_blank">claim</A> that 30G + 150G EBS drives are mounter to every node by default. But if I use instance type like r5d.2xlarge, it already has local disk so I want to avoid mounting the 150G EBS drive to it. Is there a way to do it?</P><P></P><P>We usually use instance pools for our jobs, and I tried to create one with disk_spec.disk_count = 0, but it didn't work. The 150G has still been mounted to the machine.</P> Mon, 11 Jul 2022 07:13:24 GMT https://community.databricks.com/t5/data-engineering/is-there-a-way-to-avoid-using-ebs-drives-on-workers-with-local/m-p/14118#M8667 ivanychev 2022-07-11T07:13:24Z Re: Is there a way to avoid using EBS drives on workers with local NVMe SSD? https://community.databricks.com/t5/data-engineering/is-there-a-way-to-avoid-using-ebs-drives-on-workers-with-local/m-p/38797#M26764 <P>Hey Ivan, did you find a way to do this?</P> Tue, 01 Aug 2023 01:09:53 GMT https://community.databricks.com/t5/data-engineering/is-there-a-way-to-avoid-using-ebs-drives-on-workers-with-local/m-p/38797#M26764 pabloanzorenac 2023-08-01T01:09:53Z