How to use mlflow to log a composite estimator (multiple pipes) and then deploy it as rest endpoint

prafull
New Contributor

Hello,

I am trying to deploy a composite estimator as single model, by logging the run with mlflow and registering the model.

Can anyone help with how this can be done? This estimator contains different chains-

  1. text: data- tfidf- svm- svm.decision_function- text_dense matrix
  2. cat: data- encoding- scaling- cat_ matrix
  3. Light GBM- gets both concatenated (text_dense matrix,  cat_ matrix)

I am using different pipelines for this, as its not possible to create a single transformer/pipe. below is the model blueprint. I need to train and deploy model on a databricks serving enpoint

 

Screenshot 2024-01-17 000758.png