- 5432 Views
- 5 replies
- 7 kudos
Resolved! What's the easiest way to upsert data into a table? (Azure ADLS Gen2)
I had been trying to upsert rows into a table in Azure Blob Storage (ADLS Gen 2) based on two partitions (sample code below). insert overwrite table new_clicks_table partition(client_id, mm_date) select click_id ,user_id ,click_timestamp_gmt ,ca...
- 5432 Views
- 5 replies
- 7 kudos
Latest Reply
- 7 kudos
Below code might help youPython- (df.write .mode("overwrite") .option("partitionOverwriteMode", "dynamic") .saveAsTable("default.people10m") ) SQL- SET spark.sql.sources.partitionOverwriteMode=dynamic; INSERT OVERWRITE TABLE default.people10m...
- 7 kudos