Hi I'm facing an issue when writing to a salesforce object. I'm using the springml/spark-salesforce library. I have the above libraries installed as recommended based on my research.
I try to write like this:
(_sqldf
.write
.format("com.springml.spark.salesforce")
.option("username", sf_username)
.option("password", sf_password_token)
.option("sfObject", sf_object)
.option("upsert", True)
.save())
But I am receiving this error:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 15.0 failed 4 times, most recent failure: Lost task 0.3 in stage 15.0 (TID 15) (10.139.64.32 executor 0): java.lang.IllegalArgumentException: Can not instantiate Stax reader for XML source type class org.codehaus.stax2.io.Stax2ByteArraySource (unrecognized type)