Cluster list in Microsoft.Azure.Databricks.Client fails because ClusterSource enum does not include MODELS. When you have a model serving cluster, Clu...

vizoso
Databricks Partner

Cluster list in Microsoft.Azure.Databricks.Client fails because ClusterSource enum does not include MODELS.

When you have a model serving cluster, ClustersApiClient.List method fails to deserialize the API response because that cluster has MODELS as ClusterSource, which is not supported by the enum.

vizoso
Databricks Partner

Hi Kaniz.

Yes, I have an API that uses that method of the SDK to retrieve the status of the clusters in the workspace and show it in a web site. If we activate Model Serving, a cluster is created that makes the SDK (and therefore, our API) fail.

We are going to try the preview of Serverless Model Serving, so we will probably not have this type of clusters in the future but, right now, it´s failing. We have tried with the 2.0.0-RC version of the SDK, in case it was fixed, but it has the same issue.