Resolved! How to set properties for a delta table when I want to write a DataFrame?
Hi,I have a PySpark DataFrame with 11 million records. I created the DataFrame on a cluster. It is not saved on DBFS or storage account. import pyspark.sql.functions as F from pyspark.sql.functions import col, when, floor, expr, hour, minute, to_time...
- 3111 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @Mohammad Saber​ , Are you getting the error while writing the file to the table? Or before that?
- 1 kudos