cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Logging Machine Learning model to a centralized workspace from a Databricks workspace

SKandiga
New Contributor

hi all,

I have been working on the concept on of centralized workspace where I have been trying to create a centralized workspace repo.

I am running my model on Workspace A, while I am logging my model on to a remote Databricks workspace B, 

I have connected the two repo's by using set_tracking_uri(), 

destination_workspace_url = "xxxxxxxxxxxxxxxxxxxxxx"
destination_access_token = "xxxxxxxxxxxxxxxxxxxxxxxx"
 
import mlflow
import os
from mlflow.tracking import MlflowClient
client = MlflowClient()
os.environ['MLFLOW_TRACKING_TOKEN'] = destination_access_token
mlflow.set_tracking_uri(destination_workspace_url)
tracking_uri = mlflow.set_tracking_uri(destination_workspace_url)
experiment = mlflow.set_experiment("/Users/xxxxxxxxxxxxx/mlFlow_centralized_rep")
print(experiment)
 
Now the connection is successful, also the hyper parameters and the output score is getting logged but when I am trying to log the model using the command ,
  mlflow.pyfunc.log_model("random_forest_model_v10", python_model=wrappedModel, conda_env=conda_env, signature=signature)
this doesn't seem to work I am encountered with the following error,
REST EXCEPTION: Resource id "xxxxxxxxx" does not exist.
 
I have tried configuring the compute cluster with the databricks configure --token
 
But this does not seem to work, it's not logging the artifacts that's the main issue here. Any suggestions on this please ?
0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group