I've run in to the same issue using SparkTrials.

Runs fine manually.

Runs using only Trials in the workflow.

Get this error when using SparkTrials.

I've tried dropping parallelism right down, making sure there's only one experiment on that cluster.

Did you get to the bottom of the issue?