Databricks Community

NhanNguyen · 3 weeks ago

Everytime I run parallel job it always failed with this error:

ConcurrentAppendException: Files were added to the root of the table by a concurrent update. Please try the operation again.

I did a lot of reseaches also create liquid clustering table and row level concurrency but it still failed.

Note: I can pass with retry method, but my boss doesn't like that approach. Does anyone can help me on this case?

Thanks you very much!

Please see detailt my table configuration in attachment picture.

NhanNguyen · 3 weeks ago

Note: I tried both DBR 13.3.x and 14.3.x but still failed with same error

cgrant · 3 weeks ago

See this chart for a description of how row-level concurrency works. With row-level concurrency, concurrent merge operations still cannot safely modify the same row. Without row-level concurrency, concurrenty merge operations cannot safely modify the same partition.

Here are two strategies for handling this (there may be more):

With each merge statement, ensure that you have a disjoint predicate to make sure that only one merge touches a swath of data at a given point in time. For example, we have a table that contains data for many global regions (AMER, EUROPE, ASIA) and we want to concurrently merge into this table. With merge 1, provide region = 'AMER' as an extra predicate. Merge 2, include region = 'EUROPE', etc.
Union your operations together and avoid the concurrency issue altogether

Please be aware that target tables with identity columns enabled do not support concurrent operations, regardless of disjoint predicates.

NhanNguyen · 3 weeks ago

Hi @cgrant,

Thanks for your checking, Could you please help me review on this?I also did the disjoint predicate here is my condition for merge,

[

'target.ClientCode = source.ClientCode',

'target.ReportingPeriodCadenceID <=> source.ReportingPeriodCadenceID',

'target.ReportingPeriodID <=> source.ReportingPeriodID',

'target.ClientCode = source.ClientCode',

'target.AccountReferenceID = source.AccountReferenceID',

'target.ReportingPeriodID = 867',

"target.ClientCode = 'AMEX'"

]

I specific two columns that is clustered by before ('target.ReportingPeriodID = 867', "target.ClientCode = 'AMEX'") but still failed with the same issue.

cgrant · 3 weeks ago

What do the other merge commands look like?

NhanNguyen · 3 weeks ago

Hi @cgrant,

Here is my full merge and condtion:

Thanks for your reviewing

NhanNguyen · 2 weeks ago

Hi @cgrant,
Do you have any update on this? Thanks and very appreciate for your help!

cgrant · 2 weeks ago

Thanks for sharing. In the original screenshots I've noticed that you've set delta.isolationLevel to Serializable, which is the strongest (and most strict) level. Please try WriteSerializable, which is the default level.