The solution works as long as the cluster is running:

However, it does not replay all jobs if cluster is terminated (Example the job cluster from pipeline finished after hours)

So how can we replay the full spark UI from a finished job cluster?