cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 
Help
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Efficiently Delete/Update/Insert Large Datasets of Records in PostgreSQL from Spark DataFrame

skohade1
New Contributor II

โ€Ž05-21-2025 07:42 AM

So I am migrating my ETL Process from Pentaho to Databricks I am using pyspark.

I have posted all the details here Staging Ground: How to Insert,Update,Delete data using databricks for large records in PostgreSQL fr...
Can anyone please help me giving the solution to optimize the way to do the operations?

 

1 REPLY 1

Advika
Databricks Employee
Databricks Employee

โ€Ž05-22-2025 03:46 AM

Hello @skohade1!

The link you provided isn't accessible. Could you please share the relevant details directly here? This will help Community members better understand your scenario.

0 Kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now
Announcements