topic Re: Is it possible to obtain a job's event log via the REST API? in Get Started Discussions https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105792#M9083 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/142679">@mrstevegross</a>,</P> <P>Unfortunately the API job/get does not have event logs in its output. I will see if there is a workaround, but as far as I can tell from REST API might no be possible.</P> Wed, 15 Jan 2025 19:17:47 GMT Alberto_Umana 2025-01-15T19:17:47Z Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105791#M9082 <P>Currently, to investigate job performance, I can look at a job's information (via the UI) to see the "Event Log" (pictured below):</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="mrstevegross_0-1736967992555.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/14150iD87CED0C29D76505/image-size/medium?v=v2&amp;px=400" role="button" title="mrstevegross_0-1736967992555.png" alt="mrstevegross_0-1736967992555.png" /></span></P><P>I'd like to obtain this information programmatically, so I can analyze it across jobs. However, the docs for the `get` call (<A href="https://docs.databricks.com/api/workspace/jobs/get" target="_blank">https://docs.databricks.com/api/workspace/jobs/get</A>) do not appear to include information about the event log. Is there a way to get this info via the REST API?</P> Wed, 15 Jan 2025 19:07:08 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105791#M9082 mrstevegross 2025-01-15T19:07:08Z Re: Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105792#M9083 <P>Hi&nbsp;<a href="https://community.databricks.com/t5/user/viewprofilepage/user-id/142679">@mrstevegross</a>,</P> <P>Unfortunately the API job/get does not have event logs in its output. I will see if there is a workaround, but as far as I can tell from REST API might no be possible.</P> Wed, 15 Jan 2025 19:17:47 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105792#M9083 Alberto_Umana 2025-01-15T19:17:47Z Re: Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105793#M9084 <P>Can you give me more context on why do you need event logs?</P> Wed, 15 Jan 2025 19:18:41 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105793#M9084 Alberto_Umana 2025-01-15T19:18:41Z Re: Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105794#M9085 <P>Darn, well, good to know. Can y'all consider this a feature request in that case?</P> Wed, 15 Jan 2025 19:25:47 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105794#M9085 mrstevegross 2025-01-15T19:25:47Z Re: Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105795#M9086 <P>Sure, I want to assess the overall performance of our Spark jobs, particularly the time between "CREATING" and "RUNNING". It's very time-consuming to gather this data manually via the UI; if there is a way to get it programmatically that would be great.</P> Wed, 15 Jan 2025 19:26:57 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/105795#M9086 mrstevegross 2025-01-15T19:26:57Z Re: Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/111165#M9087 <P>Followup: I see that there is documentation on exporting Spark logs (<A href="https://docs.databricks.com/aws/en/compute/clusters-manage#event-log" target="_blank">https://docs.databricks.com/aws/en/compute/clusters-manage#event-log</A>) and init script logging (<A href="https://docs.databricks.com/aws/en/init-scripts/logs#init-script-events" target="_blank">https://docs.databricks.com/aws/en/init-scripts/logs#init-script-events</A>). I've been able to export the spark logs itself, but I'm not seeing the job event information there. Is there some way to gather the event log via these mechanisms?</P> Tue, 25 Feb 2025 21:33:44 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/111165#M9087 mrstevegross 2025-02-25T21:33:44Z Re: Is it possible to obtain a job's event log via the REST API? https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/111167#M9088 <P>I also see there is a "list cluster events" API (<A href="https://docs.databricks.com/api/workspace/clusters/events" target="_blank">https://docs.databricks.com/api/workspace/clusters/events</A>); can I get the event log this way?</P> Tue, 25 Feb 2025 21:43:33 GMT https://community.databricks.com/t5/get-started-discussions/is-it-possible-to-obtain-a-job-s-event-log-via-the-rest-api/m-p/111167#M9088 mrstevegross 2025-02-25T21:43:33Z