How to Get spark history server logs using python REST API

parimalpatil28
New Contributor III

Hello,

I am trying to load logs from spark job in remote location using Python Rest API.

I want to collect those logs for particular job runs using runID field, that log should contain Errors, Exceptions, and print details.

I have tried "/api/2.1/jobs/runs/get" and "/api/2.1/jobs/runs/get-output" but didnt get desired output logs.

basically I want logs from spark history server.

Let me know what method or call I can use in such case

Thanks in Advance 

Parimal

parimalpatil28
New Contributor III

Hello,

How can I access endpoint (http URL) of spark history server for a particular cluster?

 

 

Thanks,

Parimal