Thx for your details.

How we can roll back to 15.4.24?

We config the cluster type only at an yaml, not the running time version.

 job_clusters:
- job_cluster_key: default
new_cluster:
spark_version: 15.4.x-scala2.12
node_type_id: Standard_D64s_v3
autoscale:
min_workers: 1
max_workers: 5
enable_elastic_disk: true
data_security_mode: SINGLE_USER
spark_conf:
spark.databricks.pip.ignoreSSL: true
spark.sql.inMemoryColumnarStorage.compressed: true
spark.sql.adaptive.enabled: true
spark.sql.adaptive.coalescePartitions.enabled: true
spark.databricks.delta.schema.autoMerge.enabled: true
spark.databricks.adaptive.autoOptimizeShuffle.enabled: true
spark.executor.heartbeatInterval: 300000
spark.network.timeout: 320000
spark.sql.codegen: true
 

Greetings