https://community.databricks.com/t5/data-engineering/optimize-azure-vm-aws-ec2-gke-cloud-infrastructure-costs/m-p/33913#M24814 <P><B>Tips on Reducing Cloud Compute Infrastructure Costs for Azure VM, AWS EC2, and GCP GKE on Databricks</B></P><P></P><P>Databricks takes advantage of the latest Azure VM / AWS EC2 / GKE VM/instance types to ensure you get the best price performance for your workloads on top of the optimizations from the <A href="https://www.databricks.com/product/photon" alt="https://www.databricks.com/product/photon" target="_blank"><U>Databricks Photon Engine</U></A> and our <A href="https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html#:~:text=Today%2C%20we%20are%20proud%20to,reviewed%20by%20the%20TPC%20council." alt="https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html#:~:text=Today%2C%20we%20are%20proud%20to,reviewed%20by%20the%20TPC%20council." target="_blank"><U>Databricks runtime optimizations</U></A>. On AWS you can take advantage of the latest <A href="https://www.databricks.com/blog/2022/04/18/announcing-databricks-support-for-aws-graviton2-with-up-to-3x-better-price-performance.html" alt="https://www.databricks.com/blog/2022/04/18/announcing-databricks-support-for-aws-graviton2-with-up-to-3x-better-price-performance.html" target="_blank"><U>AWS Graviton2 instances</U></A>.</P><P></P><P>Databricks also allows you to <A href="https://www.databricks.com/blog/2016/10/25/running-apache-spark-clusters-with-spot-instances-in-databricks.html" alt="https://www.databricks.com/blog/2016/10/25/running-apache-spark-clusters-with-spot-instances-in-databricks.html" target="_blank"><U>save up to 80%</U></A> on Azure VM / AWS EC2 / GKE costs through the use of <A href="https://docs.databricks.com/clusters/cluster-config-best-practices.html#on-demand-and-spot-instances" alt="https://docs.databricks.com/clusters/cluster-config-best-practices.html#on-demand-and-spot-instances" target="_blank"><U>EC2 Spot Instances</U></A>, <A href="https://docs.microsoft.com/en-us/azure/databricks/clusters/cluster-config-best-practices#---on-demand-and-spot-instances" alt="https://docs.microsoft.com/en-us/azure/databricks/clusters/cluster-config-best-practices#---on-demand-and-spot-instances" target="_blank"><U>Azure Spot VMs</U></A>, or <A href="https://docs.gcp.databricks.com/clusters/configure.html?&amp;_ga=2.109875205.1834991441.1661144247-1468227001.1645719051#use-preemptible-instances" alt="https://docs.gcp.databricks.com/clusters/configure.html?&amp;_ga=2.109875205.1834991441.1661144247-1468227001.1645719051#use-preemptible-instances" target="_blank"><U>GCP Preemptible VM Instances</U></A> which allow you to leverage spare cloud compute capacity at deep discounts.</P><P></P><P>Let us know below if you have any additional tips and tricks for saving costs on cloud compute in the comments!</P> Tue, 23 Aug 2022 07:05:12 GMT isaac_gritz 2022-08-23T07:05:12Z https://community.databricks.com/t5/data-engineering/optimize-azure-vm-aws-ec2-gke-cloud-infrastructure-costs/m-p/33913#M24814 <P><B>Tips on Reducing Cloud Compute Infrastructure Costs for Azure VM, AWS EC2, and GCP GKE on Databricks</B></P><P></P><P>Databricks takes advantage of the latest Azure VM / AWS EC2 / GKE VM/instance types to ensure you get the best price performance for your workloads on top of the optimizations from the <A href="https://www.databricks.com/product/photon" alt="https://www.databricks.com/product/photon" target="_blank"><U>Databricks Photon Engine</U></A> and our <A href="https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html#:~:text=Today%2C%20we%20are%20proud%20to,reviewed%20by%20the%20TPC%20council." alt="https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html#:~:text=Today%2C%20we%20are%20proud%20to,reviewed%20by%20the%20TPC%20council." target="_blank"><U>Databricks runtime optimizations</U></A>. On AWS you can take advantage of the latest <A href="https://www.databricks.com/blog/2022/04/18/announcing-databricks-support-for-aws-graviton2-with-up-to-3x-better-price-performance.html" alt="https://www.databricks.com/blog/2022/04/18/announcing-databricks-support-for-aws-graviton2-with-up-to-3x-better-price-performance.html" target="_blank"><U>AWS Graviton2 instances</U></A>.</P><P></P><P>Databricks also allows you to <A href="https://www.databricks.com/blog/2016/10/25/running-apache-spark-clusters-with-spot-instances-in-databricks.html" alt="https://www.databricks.com/blog/2016/10/25/running-apache-spark-clusters-with-spot-instances-in-databricks.html" target="_blank"><U>save up to 80%</U></A> on Azure VM / AWS EC2 / GKE costs through the use of <A href="https://docs.databricks.com/clusters/cluster-config-best-practices.html#on-demand-and-spot-instances" alt="https://docs.databricks.com/clusters/cluster-config-best-practices.html#on-demand-and-spot-instances" target="_blank"><U>EC2 Spot Instances</U></A>, <A href="https://docs.microsoft.com/en-us/azure/databricks/clusters/cluster-config-best-practices#---on-demand-and-spot-instances" alt="https://docs.microsoft.com/en-us/azure/databricks/clusters/cluster-config-best-practices#---on-demand-and-spot-instances" target="_blank"><U>Azure Spot VMs</U></A>, or <A href="https://docs.gcp.databricks.com/clusters/configure.html?&amp;_ga=2.109875205.1834991441.1661144247-1468227001.1645719051#use-preemptible-instances" alt="https://docs.gcp.databricks.com/clusters/configure.html?&amp;_ga=2.109875205.1834991441.1661144247-1468227001.1645719051#use-preemptible-instances" target="_blank"><U>GCP Preemptible VM Instances</U></A> which allow you to leverage spare cloud compute capacity at deep discounts.</P><P></P><P>Let us know below if you have any additional tips and tricks for saving costs on cloud compute in the comments!</P> Tue, 23 Aug 2022 07:05:12 GMT https://community.databricks.com/t5/data-engineering/optimize-azure-vm-aws-ec2-gke-cloud-infrastructure-costs/m-p/33913#M24814 isaac_gritz 2022-08-23T07:05:12Z