balajij8
Esteemed Contributor

The issue arises as Predictive Optimization runs optimization when you have high frequency ingestion, With high frequency writes - transaction log grows rapidly leading to optimization and writes colliding.

You can

  • Move to 30-minute table updates.
  • Move to Explicit Liquid Clustering
  • Move to manual Optimization for the specific tables

View solution in original post