Sorry wrongly stated. Check below ones if this works.

spark.conf.set(
"spark.sql.streaming.stateStore.rocksdb.changelogCheckpointing.enabled",
"true"
)

https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/rocksdb-state-store?utm_sour...

LR