https://community.databricks.com/t5/community-articles/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python/m-p/138640#M783 <P>Wanted to share something that might save others time and money. We had a complex Databricks script that ran over 1.5 hours, when the target was under 20 minutes. Initially tried scaling up the cluster, but real progress came from simply upgrading the Databricks Runtime to version 16 — the script finished in just 8 minutes, no code changes needed.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="cluster16.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/21581i0B77B764F933952C/image-size/medium?v=v2&amp;px=400" role="button" title="cluster16.png" alt="cluster16.png" /></span></P><DIV class="">&nbsp;</DIV><DIV class="">Have you seen similar performance gains after a Runtime update? Would love to hear your stories!</DIV><P>I wrote up the details and included log examples in this Medium post (<A href="https://medium.com/@protmaks/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python-script-by-10x-e1109677265a" target="_blank" rel="noopener">https://medium.com/@protmaks/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python-script-by-10x-e1109677265a</A>).<BR /><BR /></P> Tue, 11 Nov 2025 18:45:24 GMT protmaksim 2025-11-11T18:45:24Z https://community.databricks.com/t5/community-articles/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python/m-p/138640#M783 <P>Wanted to share something that might save others time and money. We had a complex Databricks script that ran over 1.5 hours, when the target was under 20 minutes. Initially tried scaling up the cluster, but real progress came from simply upgrading the Databricks Runtime to version 16 — the script finished in just 8 minutes, no code changes needed.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="cluster16.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/21581i0B77B764F933952C/image-size/medium?v=v2&amp;px=400" role="button" title="cluster16.png" alt="cluster16.png" /></span></P><DIV class="">&nbsp;</DIV><DIV class="">Have you seen similar performance gains after a Runtime update? Would love to hear your stories!</DIV><P>I wrote up the details and included log examples in this Medium post (<A href="https://medium.com/@protmaks/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python-script-by-10x-e1109677265a" target="_blank" rel="noopener">https://medium.com/@protmaks/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python-script-by-10x-e1109677265a</A>).<BR /><BR /></P> Tue, 11 Nov 2025 18:45:24 GMT https://community.databricks.com/t5/community-articles/how-upgrading-to-databricks-runtime-16-4-sped-up-our-python/m-p/138640#M783 protmaksim 2025-11-11T18:45:24Z