I am trying to write Pandas core dataframe into avro format as below. But I get the following error:
AttributeError: 'DataFrame' object has no attribute 'write'
I have tried several options as below:
df_2018_pd.write.format("com.databricks.spark.avro").save("s3://folder/sub-folder/avro") df_2018_pd.write.format("avro").save("s3://folder/sub-folder/avro") df_2018_pd.write().format("com.databricks.spark.avro").save("s3://folder/sub-folder/avro") df_2018_pd.format("avro").save("s3://folder/sub-folder/avro")
All of the above gives error.
Any help would be appreciated.