https://community.databricks.com/t5/data-engineering/job-cluster-s-cpu-utilization-goes-higher-than-100-few-times/m-p/68063#M33537 <P>I have Data Engineering Pipeline workload that run on Databricks.</P><P>Job cluster has following configuration :-&nbsp;</P><P>Worker&nbsp; i3.4xlarge with 122 GB memory and 16 cores</P><P>Driver i3.4xlarge with 122 GB memory and 16 cores ,</P><P>Min Worker -4 and Max Worker 8</P><P>&nbsp;</P><P>We noticed that CPU utlization goes higher than 100% few times as a spike.</P><P>Can someone help me to understand following questions</P><P>1- Are these High CPU Utilization Spikes Problematic</P><P>2- Is there any way to check the DBX Job cluster log to see the CPU utilization</P><P>3- What is the max limit for CPU utilization and how does this whole things work.</P> Fri, 03 May 2024 14:58:14 GMT AKUMAR_DEngg 2024-05-03T14:58:14Z https://community.databricks.com/t5/data-engineering/job-cluster-s-cpu-utilization-goes-higher-than-100-few-times/m-p/68063#M33537 <P>I have Data Engineering Pipeline workload that run on Databricks.</P><P>Job cluster has following configuration :-&nbsp;</P><P>Worker&nbsp; i3.4xlarge with 122 GB memory and 16 cores</P><P>Driver i3.4xlarge with 122 GB memory and 16 cores ,</P><P>Min Worker -4 and Max Worker 8</P><P>&nbsp;</P><P>We noticed that CPU utlization goes higher than 100% few times as a spike.</P><P>Can someone help me to understand following questions</P><P>1- Are these High CPU Utilization Spikes Problematic</P><P>2- Is there any way to check the DBX Job cluster log to see the CPU utilization</P><P>3- What is the max limit for CPU utilization and how does this whole things work.</P> Fri, 03 May 2024 14:58:14 GMT https://community.databricks.com/t5/data-engineering/job-cluster-s-cpu-utilization-goes-higher-than-100-few-times/m-p/68063#M33537 AKUMAR_DEngg 2024-05-03T14:58:14Z