cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Impossible to read a custom pipeline? (Scala)

nolanreilly
New Contributor II

I have created a custom transformer to be used in a ml pipeline. I was able to write the pipeline to storage by extending the transformer class with DefaultParamsWritable. Reading the pipeline back in however, does not seem possible in Scala. I have tried creating a companion object with DefaultParamsReadable as seen here, but this still raises a java.lang.nosuchmethodexception (when using PipelineModel.load("path")).

Does anyone have a solution to reading custom transformers in Scala? Thank you.

1 REPLY 1

WarrenO
New Contributor III

Hi, did you ever find a solution for this?