Anonymous
Not applicable
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-07-2023 10:52 PM
@ELENI GEORGOUSI :
- Load the data from the two tables into PySpark DataFrames: df1 and df2
- Join the two DataFrames on their common columns: call it df
- Define a user-defined function (UDF) that implements your IF statement
- Add a new column to the DataFrame that computes using the UDF
- Insert the data into the target table
- Update the source tables:
Hope this helps to give you a framework on how to think and go about curser.