https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102246#M2320 <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Abishrp_1-1734352143264.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/13553i5CC43330073A1A54/image-size/medium?v=v2&amp;px=400" role="button" title="Abishrp_1-1734352143264.png" alt="Abishrp_1-1734352143264.png" /></span><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Abishrp_2-1734352154514.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/13554i1CAAE0FE68C0697C/image-size/medium?v=v2&amp;px=400" role="button" title="Abishrp_2-1734352154514.png" alt="Abishrp_2-1734352154514.png" /></span></P><P>&nbsp;</P> Mon, 16 Dec 2024 12:29:31 GMT Abishrp 2024-12-16T12:29:31Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102198#M2311 <P>For some of my clusters i can able to find data in&nbsp;&nbsp;system.compute.node_timeline table to view utilization details even after 36 hrs since the run.</P> Mon, 16 Dec 2024 06:46:44 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102198#M2311 Abishrp 2024-12-16T06:46:44Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102223#M2312 <P>If you check at the metrics tab of the specific cluster in the UI does it actually shows data?</P> Mon, 16 Dec 2024 11:42:07 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102223#M2312 Walter_C 2024-12-16T11:42:07Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102227#M2313 <P>No, there is no data.</P> Mon, 16 Dec 2024 11:45:50 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102227#M2313 Abishrp 2024-12-16T11:45:50Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102233#M2315 <P>Ok how many time was the cluster running? Sometimes depending on the time of the run there is no data populated to the metrics tab so probably wont be on the system table.</P> Mon, 16 Dec 2024 11:56:09 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102233#M2315 Walter_C 2024-12-16T11:56:09Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102234#M2316 <P>Mostly this issue occurs in Job Compute clusters. It runs 3 times a day. Sometimes, driver details not available and sometimes both worker and driver data not available.</P> Mon, 16 Dec 2024 11:59:07 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102234#M2316 Abishrp 2024-12-16T11:59:07Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102237#M2317 <P>Does this job completes really fast, once the cluster is up how many time does it takes to complete the run?</P> Mon, 16 Dec 2024 12:04:01 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102237#M2317 Walter_C 2024-12-16T12:04:01Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102238#M2318 <P>In a particular job, I use job compute with 1 worker in a particular task, the particular task completed in 11 minutes.</P> Mon, 16 Dec 2024 12:10:47 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102238#M2318 Abishrp 2024-12-16T12:10:47Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102241#M2319 <P>Adding to my previous reply, during the same job run, i also use another job compute with single worker to run another task, this task completes in 6 minutes. For this job compute i get only worker data in system table.</P> Mon, 16 Dec 2024 12:18:46 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102241#M2319 Abishrp 2024-12-16T12:18:46Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102246#M2320 <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Abishrp_1-1734352143264.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/13553i5CC43330073A1A54/image-size/medium?v=v2&amp;px=400" role="button" title="Abishrp_1-1734352143264.png" alt="Abishrp_1-1734352143264.png" /></span><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Abishrp_2-1734352154514.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/13554i1CAAE0FE68C0697C/image-size/medium?v=v2&amp;px=400" role="button" title="Abishrp_2-1734352154514.png" alt="Abishrp_2-1734352154514.png" /></span></P><P>&nbsp;</P> Mon, 16 Dec 2024 12:29:31 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102246#M2320 Abishrp 2024-12-16T12:29:31Z https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102276#M2321 <P>Yes seems that the runs are 1 minute of execution so this might be the reason why the metrics are not loaded</P> Mon, 16 Dec 2024 16:50:46 GMT https://community.databricks.com/t5/data-governance/issue-in-system-compute-node-timeline-table/m-p/102276#M2321 Walter_C 2024-12-16T16:50:46Z