My DLT jobs are experiencing throttling due to the following error message:
[GC (GCLocker Initiated GC) [PSYoungGen: 5431990K->102912K(5643264K)] 9035507K->3742053K(17431552K), 0.1463381 secs] [Times: user=0.29 sys=0.00, real=0.14 secs]
I came across some articles suggesting that switching to G1GC could help resolve this issue.
However, in Serverless and Dedicated clusters for DLT, I don’t see an option to modify the garbage collection settings. Could you provide guidance on how to address this?