topic Re: How to write to Salesforce object using Spark Salesforce Library in Data Engineering

How to write to Salesforce object using Spark Salesforce Library

theSoyf — Wed, 14 Dec 2022 13:21:46 GMT

Hi I'm facing an issue when writing to a salesforce object. I'm using the springml/spark-salesforce library. I have the above libraries installed as recommended based on my research.

I try to write like this:

(_sqldf

.write

.format("com.springml.spark.salesforce")

.option("username", sf_username)

.option("password", sf_password_token)

.option("sfObject", sf_object)

.option("upsert", True)

.save())

But I am receiving this error:

org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 15.0 failed 4 times, most recent failure: Lost task 0.3 in stage 15.0 (TID 15) (10.139.64.32 executor 0): java.lang.IllegalArgumentException: Can not instantiate Stax reader for XML source type class org.codehaus.stax2.io.Stax2ByteArraySource (unrecognized type)

Re: How to write to Salesforce object using Spark Salesforce Library

Aviral-Bhardwaj — Tue, 20 Dec 2022 14:12:51 GMT

this could not be the whole error can you please share the driver/error logs thread dump, I will try to help you

Re: How to write to Salesforce object using Spark Salesforce Library

Gauthy — Wed, 15 Feb 2023 12:07:49 GMT

Im facing the same issue while trying to write to Salesforce, if you have found a resolution could you please share it ?