Job Compute

mkwparth
Databricks Partner

Hey Community, I’m new to this platform and need some guidance.

I’ve set up a job on a basic compute configuration: 8GB RAM, 4 Core CPU, 1 Worker (Standard F4), with DLT runtime 16.4.8. However, my job is running slower than expected. When I checked the cluster metrics, I noticed that the Memory Swap Utilization is peaking, which I suspect might be causing the slowdown.

I’ve attached the chart for reference. Could you please take a look and let me know what the best approach would be? Should I increase the cluster memory, or is there another way to handle this? Also, I’m a bit unclear about what exactly the Memory Swap Utilization chart indicates—would appreciate some clarification on that too.

Thanks in advance!