topic Re: How do i create a custom encoder to enable use of custom data objects with pyspark datasets? in Data Engineering https://community.databricks.com/t5/data-engineering/how-do-i-create-a-custom-encoder-to-enable-use-of-custom-data/m-p/25562#M17801 <P>Can you elaborate mode what you mean by "Encoder" (is it a serializing mechanism), what are the custom data objects? pyspark does support complex and binary formats as long as you can write your own serializer/deserializer.</P> Fri, 18 Jun 2021 23:51:09 GMT Mooune_DBU 2021-06-18T23:51:09Z How do i create a custom encoder to enable use of custom data objects with pyspark datasets? https://community.databricks.com/t5/data-engineering/how-do-i-create-a-custom-encoder-to-enable-use-of-custom-data/m-p/25561#M17800 Tue, 08 Jun 2021 17:21:02 GMT https://community.databricks.com/t5/data-engineering/how-do-i-create-a-custom-encoder-to-enable-use-of-custom-data/m-p/25561#M17800 RonanStokes_DB 2021-06-08T17:21:02Z Re: How do i create a custom encoder to enable use of custom data objects with pyspark datasets? https://community.databricks.com/t5/data-engineering/how-do-i-create-a-custom-encoder-to-enable-use-of-custom-data/m-p/25562#M17801 <P>Can you elaborate mode what you mean by "Encoder" (is it a serializing mechanism), what are the custom data objects? pyspark does support complex and binary formats as long as you can write your own serializer/deserializer.</P> Fri, 18 Jun 2021 23:51:09 GMT https://community.databricks.com/t5/data-engineering/how-do-i-create-a-custom-encoder-to-enable-use-of-custom-data/m-p/25562#M17801 Mooune_DBU 2021-06-18T23:51:09Z