error loading databricks.proto

[FranPérez]

Hi,

I'm using a DBR 13.3 LTS ML, and I want to set up a webhook trigger. I'm following the example notebook at https://learn.microsoft.com/en-us/azure/databricks/_extras/notebooks/source/mlflow/mlflow-model-regi.... 

This is the code I'm using:

%pip install databricks-registry-webhooks
dbutils.library.restartPython() # not needed for DBR < 13.3
from databricks_registry_webhooks import RegistryWebhooksClient, JobSpec, HttpUrlSp

The last line throws the following error:

TypeError: Couldn't build proto file into descriptor pool! Invalid proto descriptor for file "databricks.proto": databricks.proto: A file with this name is already in the pool.

Finally, I successfully tested the same issue on DBR 10.4 ML, 11.3 ML and 12.2 ML with no errors

[Kaniz]

Hi @FranPérez, This error typically occurs when there's a conflict with protobuf versions or when the same proto file is imported multiple times.

It might be related to the specific DBR version you're using (13.3 LTS ML) and some incompatibility with the databricks-registry-webhooks library.

I recommend checking the library's compatibility with your DBR version and if necessary, reaching out to Databricks support by filing a support ticket for further assistance.

[StephanieRivera · Accepted solution]

Hi @FranPérez ,

The issue is that databricks-registry-webhooks has a databricks.proto file that collides with mlflow. Here is the fix:

%pip install databricks-registry-webhooks mlflow==2.2.2

I also posted the fix on StackOverflow: https://stackoverflow.com/a/78097127/1290485