hi all - I have created a data frame and would like to save in delta format using df.write.format("delta").saveAsTable("tablename") Its not working and throws " AnalysisException" . Please advise .

joakon
New Contributor III
 

Pat
Esteemed Contributor

Hi @raghu maremanda​ ,

can you please share error details?

are you using PYTHON CELL to execute the code?

I am not sure right now if it's optional or mandatory, but you could add .mode() i.e:

df.write.format("delta").mode("append").saveAsTable("tablename")
 
append or overwrite

please refer to: https://docs.delta.io/latest/delta-batch.html#write-to-a-table

joakon
New Contributor III

Thank you for your response.

This is what I have so far -

d = spark.read.option("inferSchema" ,"true").option("delimeter" ,",").option("header","true").csv('dbfs:/FileStore/tables/Devices.csv')

d.write.format("delta").mode("append").saveAsTable("devices_new")

image.png

Pat
Esteemed Contributor

@raghu maremanda​ ,

you didn't add the .mode() in your code shown.

it's still:

d.write.format("delta").saveAsTable("delta.devices_new")

I am not sure if this will help, but try:

d.write.format("delta").mode("append").saveAsTable("devices_new")

also, the error doesn't tell much. can you share the error thrown?

thanks,

Pat.

Anonymous
Not applicable

Your code is not wrong, I tried and executed from my side and no error happens.

Could you check version of DBR?

Image

View solution in original post

joakon
New Contributor III

thank you for the response. db runtime was older. issue resolved.

huyd
New Contributor III

check your read cell, "Delimeter"