cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How do i create a custom encoder to enable use of custom data objects with pyspark datasets?

RonanStokes_DB
New Contributor III
New Contributor III
 
1 REPLY 1

Mooune_DBU
Valued Contributor

Can you elaborate mode what you mean by "Encoder" (is it a serializing mechanism), what are the custom data objects? pyspark does support complex and binary formats as long as you can write your own serializer/deserializer.