ConcurrentAppendException Liquid Clustered Table Different Row Concurrent Writes
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-05-2024 08:50 AM
I have multiple databricks jobs performing a MERGE command simultaneously into the same liquid clustered table but for different rows of data and I am receiving the following error message:
[DELTA_CONCURRENT_APPEND] ConcurrentAppendException: Files were added to the root of the table by a concurrent update.
I am using databricks runtime 15.3. My understanding is with liquid clustered tables and Databricks runtime > 13.3 concurrent row-level MERGE / UPDATE operations should be possible. DeletionVectors and RowTracking are enabled in my config.