02-07-2023 08:59 AM
Hi there!
We have different jobs/workflows configured in our Databricks workspace running on AWS and would like to know who actually started the job run? Are they started by a user or a service principle using curl?
Currently one can only see, who is the owner and who created the job config but not who triggerd an actual run.
I tried to find something in the audit logs we have activated for the jobs but was not successful.
Any hints are highly welcome!
02-07-2023 08:08 PM
check the event logs
and driver logs you will find that
02-07-2023 10:07 PM
Hi!
I checked the cluster logs and looked under "Event log". Under the Event type CREATING the listed user is not who actually started the job. The name that is listed there is always the user that is given under "Run as" in the job config.
Had a look into the driver logs but did not see any user information. Could you please be more specific on where to look there or give me a search pattern I can look for?
I would like to check who started the job, not under which user the cluster will run.
02-07-2023 10:20 PM
lets connect https://www.linkedin.com/in/aviralb/ to discuss more
02-07-2023 10:46 PM
Please keep the discussion on this platform so the whole community may participate.
04-08-2023 11:52 PM
Hi @Matthias Mueller
Hope everything is going great.
Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you.
Cheers!
04-10-2023 11:01 PM
Nope, still no luck
05-11-2023 06:30 AM
Trying to find exactly the same information. No luck and no entries in search engines so far. Looking for a solution for this.
10-03-2023 08:04 PM
Hi, were you able to find the information on who started a job run? I'm also searching for this information but was not able to find it. Thanks!
Tuesday
I've just posted this idea on the Idea Portal of Databricks regarding this subject. Upvote it so it may get developed!
https://feedback.azure.com/d365community/idea/5d0fdbbf-eefb-ee11-a73c-0022485313bb
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.