igorstar
New Contributor III

If you have a large dataset, you might want to export it to a bucket in parquet format from your notebook:

%python

df = spark.sql("select * from your_table_name")
df.write.parquet(your_s3_path)