cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
VaDim
New Contributor III
since ‎08-27-2021
Wednesday

User Stats

  • 7 Posts
  • 1 Solutions
  • 2 Kudos given
  • 3 Kudos received

User Activity

transformWithStateInPandas. Invalid pickle opcode when updating ValueState with large (float) array

Wednesday
I am getting an error when the entity I need to store in a ValueState is a large array (over 15k-20k items). No error (and works correctly) if I trim the array to under 10k samples. The same error is raised when using it as a value for MapState or as...

ModuleNotFound error when using transformWithStateInPandas via a class defined outside the notebook

07-01-2025
As per Databricks documentation when I define the class that extends `StatefulProcessor` in a Notebook everything works ok however, execution fails with ModuleNotFound error as soon as the class definition is moved to a file (module) of it's own in a...

Are MERGE INTO inserts supported when the delta table has an identity column ?

09-08-2022
I can't seem to make it work as I keep getting:DeltaInvariantViolationException: NOT NULL constraint violated for column: dl_id.
Kudos given to