cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Impossible to read a custom pipeline? (Scala)

nolanreilly
New Contributor

I have created a custom transformer to be used in a ml pipeline. I was able to write the pipeline to storage by extending the transformer class with DefaultParamsWritable. Reading the pipeline back in however, does not seem possible in Scala. I have tried creating a companion object with DefaultParamsReadable as seen here, but this still raises a java.lang.nosuchmethodexception (when using PipelineModel.load("path")).

Does anyone have a solution to reading custom transformers in Scala? Thank you.

0 REPLIES 0
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.