cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Delta table version protocol

noname123
New Contributor III

I do:

df.write.format("delta").mode("append").partitionBy("timestamp").option("mergeSchema", "true").save(destination)

If table doesn't exist, it creates new table with "minReaderVersion":3,"minWriterVersion":7.
Yesterday it was creating table with "minReaderVersion":1,"minWriterVersion":2. I changed nothing and now versions are different. Setting delta protocol version on cluster does nothing.
This causes breaking change to me because some tables are used by Azure Data Factory and it's not compatible.
1 ACCEPTED SOLUTION

Accepted Solutions

noname123
New Contributor III

Thanks for help.

Issue was caused by "Auto-Enable Deletion Vectors" setting. 

View solution in original post

1 REPLY 1

noname123
New Contributor III

Thanks for help.

Issue was caused by "Auto-Enable Deletion Vectors" setting. 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group