Hello @der 

Good day!!

I see whole issue over here. As per the doc. the default size for spark.ui.retainedJobs is 1000.

ref: 

Can you increase them? 

For very large logs (e.g., 5600+ jobs), scale up further (e.g., to 100000 for retainedTasks/jobs) and use a cluster with more driver memory (e.g., via spark.driver.memory 16g)

I am waiting for your response.