Showing results for 
Search instead for 
Did you mean: 
Esteemed Contributor III
since ‎10-12-2021

User Stats

  • 1,316 Posts
  • 274 Solutions
  • 1,002 Kudos given
  • 2,046 Kudos received

User Activity

In Spark 4.0, there are no more data type mismatches when converting dynamic JSONs, as the new data type VariantType comes with a new function to parse JSONs. Stay tuned for 4.0 release.
SQL serverless now use cache even after termination thanks to the remote cache. You can benefit from 1 min auto-termination when still utilizing cache benefits.
Now, you can keep the state of stateful streaming in RocksDB. For example, retrieving keys from memory to check for duplicate records inside the watermark is now faster. #databricks