topic Databricks Custom model Serving endpoint Failing in Get Started Discussions

Databricks Custom model Serving endpoint Failing

vaidhaicha — Mon, 17 Jun 2024 18:14:10 GMT

Hello all,

I have created a custom model serving endpoint in Azure databricks. This endpoint connects with the AzureopenAI model and Azure postgres connection.All of these Azure services are with Private endpoints. When I run this notebook,I am able to make a call, but when I am querying through this serving endpoint using my PAT,its failing. May I know how can I call my Azure resources with endpoint. Is it happening because of personal access token?I am surprised how I can connect to all Azure resources through notebook but not from serving Endpoints?

Re: Databricks Custom model Serving endpoint Failing

vaidhaicha — Wed, 26 Jun 2024 15:32:42 GMT

But when I create serving endpoint , it is considered as public addresss.We dont have an option to make it private.

So basically from public address(serving endpoint), we are trying to connect to azure services (based on notebook code)on private endpoint which is not allowed. What are the other options can I try to make it work. I want this response generated by notebook to be sent instantly to the front end , so workflows cant be an option as it takes time . How to make sure databricks notebook code can be executed or used by front end application.