- 943 Views
- 3 replies
- 0 kudos
Tracing through model serving endpoint
i have deployed a code running on langgraph through model serving endpoint. I want to trace the logs using ml flow and i want to trace logs in the experiment whenever a user hits the serving endpoint. I have defined both of them in my codemlflow.set...
- 943 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @srijan1881, The behavior you are seeing is expected when using a manually created model serving endpoint rather than one deployed through the Databricks Agent Framework. Here is a breakdown of why traces are not appearing and how to resolve it. U...
- 0 kudos
- 1160 Views
- 1 replies
- 0 kudos
Model Serving Endpoints Scaling From Zero Forever
Hello,When deploying agents via a Serving Endpoint with "Scale To Zero" enabled, we are encountering that at seemingly random times, when we hit the endpoint to wake it up, it will begin to "Scale From Zero", but will never become fully available. Th...
- 1160 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @jAAmes_bentley, There are multiple possible root causes, so let me walk through them so you can diagnose which applies to your situation. WHAT HAPPENS DURING SCALE-FROM-ZERO When an endpoint scales from zero, Databricks must: 1. Acquire comp...
- 0 kudos
- 2143 Views
- 2 replies
- 0 kudos
Resolved! Clarification on Databricks Claude 3.7 Sonnet native serving endpoint data processing location.
Hello, I am trying to clarify if Databricks Claude 3.7 Native serving endpoint is safe for use in our enterprise or if it needs to be disabled.I am trying to understand if the data sent to this endpoint is kept within our geo region (UKSouth/Europe)....
- 2143 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @ChrisLawford_n1 The Databricks Claude 3.7 for UKsouth, as you can see in the documentation, can only be used if it is supported based on GPU availability and requires cross-geo routing to be enabled, so cross-geo processing that allows data for ...
- 0 kudos