Has this issue been resolved? I am using a Wrapped Catboost classifier, and sometimes I can use batch_score, and some times it gives me the same error:
"org.apache.spark.SparkException: Job aborted due to stage failure: Task 2 in stage 2094.0 failed 4 times, most recent failure: Lost task 2.3 in stage 2094.0 (TID 2825) (10.162.80.108 executor 0): org.apache.spark.SparkRuntimeException: [UDF_ERROR.ENV_LOST] Execution of function udf(named_struct(..."