Efficiently Delete/Update/Insert Large Datasets of Records in PostgreSQL from Spark DataFrame
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-21-2025 07:42 AM
So I am migrating my ETL Process from Pentaho to Databricks I am using pyspark.
I have posted all the details here Staging Ground: How to Insert,Update,Delete data using databricks for large records in PostgreSQL fr...
Can anyone please help me giving the solution to optimize the way to do the operations?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-22-2025 03:46 AM
Hello @skohade1!
The link you provided isn't accessible. Could you please share the relevant details directly here? This will help Community members better understand your scenario.