RocksDB results in empty stream/stream joins dataframe

[EhsanSaba]

Since we enable RocksDB in our spark.conf the stream to stream joins/unions results in empty dataframe, does anyone else have the same experience? it is on AWS

spark.conf.set(
"spark.sql.streaming.stateStore.providerClass",
"com.databricks.sql.streaming.state.RocksDBStateStoreProvider")

[jose_gonzalez]

Did you also update the checkpoint? You might need to use a new checkpoint after you enable the RocksDB state store.