cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to access model endpoint management APIs from workflow tasks?

fijoy
Contributor

I have created a model serving endpoint in Databricks. I'd like to now update this endpoint programmatically from a workflow task.

Following instructions on this page:

https://docs.databricks.com/machine-learning/model-serving/create-manage-serving-endpoints.html

I have written a notebook task to update the endpoint. The notebook runs fine on its own (when I run it cell by cell manually), but it fails when run as part of a workflow.

Specifically, the GET request to get the status of the model endpoint fails with the following ConnectionError exception:

ConnectionError: HTTPSConnectionPool(host='none', port=443): Max retries exceeded with url: /api/2.0/serving-endpoints/xxx (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known'))

The same exact GET request works when the notebook runs on its own. I have played with different tokens with no success.

It appears that the APIs to manage model serving endpoints aren't accessible from workflow tasks. 

Can anyone help resolve this?

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group