I have created a custom transformer to be used in a ml pipeline. I was able to write the pipeline to storage by extending the transformer class with DefaultParamsWritable. Reading the pipeline back in however, does not seem possible in Scala. I have tried creating a companion object with DefaultParamsReadable as seen here, but this still raises a java.lang.nosuchmethodexception (when using PipelineModel.load("path")).
Does anyone have a solution to reading custom transformers in Scala? Thank you.