Pandas dataframe to a table

[KiranRastogi]

I want to write a pandas dataframe to a table, how can I do this ? Write command is not working, please help.

[PaulLintilhac]

could you post the code for the "write" command you are using?

[amy_wang]

Hey Kiran,

Just taking a stab in the dark but do you want to convert the Pandas DataFrame to a Spark DataFrame and then write out the Spark DataFrame as a non-temporary SQL table?

import pandas as pd
## Create Pandas Frame
pd_df = pd.DataFrame({u'2017-01-01': 1, u'2017-01-02': 2}.items())
## Convert into Spark DataFrame
spark_df = spark.createDataFrame(pd_df)
## Write Frame out as Table
spark_df.write.mode("overwrite").saveAsTable("db.table_name")

The Python documentation for

saveAsTable

is also available here: Python API Documentation.

Amy