Hello Community,
I'm encountering a problem with Databricks Delta Tables. Specifically, I have several tables that are accessed by different processes, which include both write and update operations. The main issue arises when these operations overlap, leading to concurrency conflicts during write operations.
To mitigate this, I implemented a basic retry mechanism with up to 20 attempts. While this has reduced the frequency of the issue (it now occurs after several hours instead of more frequently), the problem still persists.
Could you please suggest a clean and effective solution to address concurrency issues in Delta Tables?
Thank you in advance for your help!
