topic No userid, username, job when making modifications on tables in Data Engineering

No userid, username, job when making modifications on tables

chevichenk — Thu, 13 Jun 2024 19:56:56 GMT

Hi, everyone!

I'm in this situation

I have some jobs that makes changes on a particular table. I use only one user to make this modifications, but then there's a process i can't identify that also makes changes on my table.

The question is, there's a reason this issue happens? and how can i identify this "phantom job"?

Thanks in advance 🙂

Re: No userid, username, job when making modifications on tables

LuisRSanchez — Fri, 14 Jun 2024 15:09:57 GMT

do you have any other application different than databricks writing into the Delta Table?

Re: No userid, username, job when making modifications on tables

shan_chandra — Fri, 14 Jun 2024 19:35:14 GMT

@chevichenk - could you please check if there are any scala jar job performing write/delete operations in parallel? Nevertheless, please raise a support case on this.

Re: No userid, username, job when making modifications on tables

chevichenk — Fri, 14 Jun 2024 21:35:40 GMT

Hi, @shan_chandra, @LuisRSanchez,

Just found that there are some .jar that are executed and are writting on this table but this .jar is called through batch

So, we think this is the cause

Thanks!

Ingrid