https://community.databricks.com/t5/get-started-discussions/how-to-choose-the-right-node-type-for-my-databricks-workload/m-p/131606#M10696 <P>Hey all, I’m setting up a Databricks workspace to run data pipelines + ML training. I’m unsure which node types to pick (driver vs worker, instance size, memory vs CPU optimized) for different workloads. For example small ETL jobs vs large batch processing, training medium‐sized ML models vs inference workloads</P><P>Can someone share how to decide on node sizing / type based on workload pattern? What are trade-offs (cost, performance, scalability)?</P> Thu, 11 Sep 2025 04:02:47 GMT Ednexllc 2025-09-11T04:02:47Z https://community.databricks.com/t5/get-started-discussions/how-to-choose-the-right-node-type-for-my-databricks-workload/m-p/131606#M10696 <P>Hey all, I’m setting up a Databricks workspace to run data pipelines + ML training. I’m unsure which node types to pick (driver vs worker, instance size, memory vs CPU optimized) for different workloads. For example small ETL jobs vs large batch processing, training medium‐sized ML models vs inference workloads</P><P>Can someone share how to decide on node sizing / type based on workload pattern? What are trade-offs (cost, performance, scalability)?</P> Thu, 11 Sep 2025 04:02:47 GMT https://community.databricks.com/t5/get-started-discussions/how-to-choose-the-right-node-type-for-my-databricks-workload/m-p/131606#M10696 Ednexllc 2025-09-11T04:02:47Z https://community.databricks.com/t5/get-started-discussions/how-to-choose-the-right-node-type-for-my-databricks-workload/m-p/131620#M10697 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/184026">@Ednexllc</a>&nbsp;,</P><P>It really depends on many factor like workload type, size of your data, number of tables etc. You can check some recommendations given by Databricks here:</P><P><A href="https://docs.databricks.com/aws/en/compute/cluster-config-best-practices" target="_blank">Compute configuration recommendations | Databricks on AWS</A></P><P>And also here - you should find useful info in section called&nbsp;Databricks Cluster Configuration and Tuning</P><P><A href="https://www.databricks.com/discover/pages/optimize-data-workloads-guide#databricks-cluster" target="_blank">Comprehensive Guide to Optimize Data Workloads | Databricks</A></P><P><BR />But for me, it’s always a process that requires some trial and error at the beginning. I try different settings, and in the end I choose the ones that handled the given workload best.</P><P>So, to put it simply - there's no silver bullet. You can use some guidelines, but in the end you need to test and align compute to your workload/envirionment yourself</P> Thu, 11 Sep 2025 06:53:42 GMT https://community.databricks.com/t5/get-started-discussions/how-to-choose-the-right-node-type-for-my-databricks-workload/m-p/131620#M10697 szymon_dybczak 2025-09-11T06:53:42Z