Can I get detailed metrics of the RocksDB that I have used in one of my streams ?

[User16826994223 · Accepted solution]

If you have configured your Structured Streaming query to use RocksDB as the state store, you can now get better visibility into the performance of RocksDB, with detailed metrics on get/put latencies, compaction latencies, cache hits, and so on. These metrics are available through the 

StreamingQueryProgress and StreamingQueryListener

 APIs for monitoring a streaming query.

More Info -https://docs.microsoft.com/en-gb/azure/databricks/spark/latest/structured-streaming/production#rocksdb-metrics