cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is it possible to obtain a job's event log via the REST API?

mrstevegross
New Contributor III

Currently, to investigate job performance, I can look at a job's information (via the UI) to see the "Event Log" (pictured below):

mrstevegross_0-1736967992555.png

I'd like to obtain this information programmatically, so I can analyze it across jobs. However, the docs for the `get` call (https://docs.databricks.com/api/workspace/jobs/get) do not appear to include information about the event log. Is there a way to get this info via the REST API?

1 ACCEPTED SOLUTION

Accepted Solutions

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @mrstevegross,

Unfortunately the API job/get does not have event logs in its output. I will see if there is a workaround, but as far as I can tell from REST API might no be possible.

View solution in original post

4 REPLIES 4

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @mrstevegross,

Unfortunately the API job/get does not have event logs in its output. I will see if there is a workaround, but as far as I can tell from REST API might no be possible.

Darn, well, good to know. Can y'all consider this a feature request in that case?

Alberto_Umana
Databricks Employee
Databricks Employee

Can you give me more context on why do you need event logs?

mrstevegross
New Contributor III

Sure, I want to assess the overall performance of our Spark jobs, particularly the time between "CREATING" and "RUNNING". It's very time-consuming to gather this data manually via the UI; if there is a way to get it programmatically that would be great.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group