Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-14-2024 05:37 AM
I do:
df.write.format("delta").mode("append").partitionBy("timestamp").option("mergeSchema", "true").save(destination)
If table doesn't exist, it creates new table with "minReaderVersion":3,"minWriterVersion":7.
If table doesn't exist, it creates new table with "minReaderVersion":3,"minWriterVersion":7.
Yesterday it was creating table with "minReaderVersion":1,"minWriterVersion":2. I changed nothing and now versions are different. Setting delta protocol version on cluster does nothing.
This causes breaking change to me because some tables are used by Azure Data Factory and it's not compatible.
1 ACCEPTED SOLUTION
Accepted Solutions
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-15-2024 05:22 AM
Thanks for help.
Issue was caused by "Auto-Enable Deletion Vectors" setting.
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-15-2024 05:22 AM
Thanks for help.
Issue was caused by "Auto-Enable Deletion Vectors" setting.

