cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

docs.databricks.com

SamSteere
New Contributor III

REST API Documentation is out of date since the release of Delta Live Tables

When using the `2.0/clusters/list` endpoint in an environment with running clusters provisioned by DLTs, the clusters will be returned with a `cluster_source` value of `PIPELINE`

This is not currently reflected in the relevant documentation which means library maintainers probably don't have the official information they need in order to update their solutions, which in certain cases will mean solutions stop working.

Newtonsoft.Json.JsonSerializationException: Error converting value "PIPELINE" to type 'System.Nullable`1[Microsoft.Azure.Databricks.Client.ClusterSource]'. Path 'clusters[1].cluster_source'. ---> System.ArgumentException: Requested value 'PIPELINE' was not found

I know this seems like a problem with the Microsoft.Azure.Databricks.Client library - but until the databricks docs are updated I can't reasonably propose an update to that library

3 REPLIES 3

susodapop
Contributor

Thanks for calling attention to this! I'll forward this to the relevant internal channels.

Just following up to say this has been picked up internally. The docs will be updated ASAP.

Vidula
Honored Contributor

Hi @Sam Steere​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group