https://community.databricks.com/t5/data-engineering/rocksdb-results-in-empty-stream-stream-joins-dataframe/m-p/67172#M33296 <P class="">Since we enable RocksDB in our spark.conf the stream to stream joins/unions results in empty dataframe, does anyone else have the same experience? it is on AWS</P><P class="">spark.conf.set(<BR />"spark.sql.streaming.stateStore.providerClass",<BR />"com.databricks.sql.streaming.state.RocksDBStateStoreProvider")</P> Wed, 24 Apr 2024 09:32:21 GMT EhsanSaba 2024-04-24T09:32:21Z https://community.databricks.com/t5/data-engineering/rocksdb-results-in-empty-stream-stream-joins-dataframe/m-p/67172#M33296 <P class="">Since we enable RocksDB in our spark.conf the stream to stream joins/unions results in empty dataframe, does anyone else have the same experience? it is on AWS</P><P class="">spark.conf.set(<BR />"spark.sql.streaming.stateStore.providerClass",<BR />"com.databricks.sql.streaming.state.RocksDBStateStoreProvider")</P> Wed, 24 Apr 2024 09:32:21 GMT https://community.databricks.com/t5/data-engineering/rocksdb-results-in-empty-stream-stream-joins-dataframe/m-p/67172#M33296 EhsanSaba 2024-04-24T09:32:21Z https://community.databricks.com/t5/data-engineering/rocksdb-results-in-empty-stream-stream-joins-dataframe/m-p/67748#M33433 <P>Did you also update the checkpoint? You might need to use a new checkpoint after you enable the RocksDB state store.</P> Tue, 30 Apr 2024 22:55:25 GMT https://community.databricks.com/t5/data-engineering/rocksdb-results-in-empty-stream-stream-joins-dataframe/m-p/67748#M33433 jose_gonzalez 2024-04-30T22:55:25Z