Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-17-2022 06:36 AM
hi all,
Currently, i am trying to write an empty delta file in data lake, to do this i am doing the following:
- Reading parquet file from my landing zone ( this file consists only of the schema of SQL tables)
df=spark.read.format('parquet').load(landingZonePath)- After this, i convert this file into the delta
df.write.format("delta").save(centralizedZonePath)- But after checking data lake i see no file
Note: Parquet file in landingzone, has the schema
Labels:
- Labels:
-
Dataframe
-
Delta File
-
Pyspark
-
Reading
-
SQL