06-05-2022 09:36 PM
@Jack Homareau Can you try union functionality with dataframes?
https://sparkbyexamples.com/pyspark/pyspark-union-and-unionall/
and then try to fill NaNs with the desired values?
