Showing results for 
Search instead for 
Did you mean: 
New Contributor II
since ‎09-23-2021

User Stats

  • 3 Posts
  • 0 Solutions
  • 2 Kudos given
  • 1 Kudos received

User Activity

Hi All,I have a daily spark job that reads and joins 3-4 source tables and writes the df in a parquet format. This data frame consists of 100+ columns. As this job run daily, our deduplication logic identifies the latest record from each of source t...
Kudos from
Kudos given to