Clarification on Databricks Claude 3.7 Sonnet native serving endpoint data processing location.

[ChrisLawford_n1]

Hello, 

I am trying to clarify if Databricks Claude 3.7 Native serving endpoint is safe for use in our enterprise or if it needs to be disabled.
I am trying to understand if the data sent to this endpoint is kept within our geo region (UKSouth/Europe). From the documentation I can see that databricks-claude-3.7-sonnet is available as a databricks hosted foundation model but only if I enable cross geography routing.(Supported foundation models on Mosaic AI Model Serving - Azure Databricks | Microsoft Learn)  

This implies to me that the model involves sending the data outside of our region. 
Currently we are have cross-geo disabled and are able to use Claude-3.7 in the AI playground, this is where my understanding is confused.
If I can only make another serving endpoint using claude-3.7 if I enable cross-geo, how is it that the native claude-3.7 endpoint is able to work when this is disabled.

Ideally I am looking for some documentation to tell me that the native claude-3.7 is hosted on databricks in my region and that it is not an external model that would mean that the data could be being sent outside the region.

[Sharanya13]

@ChrisLawford_n1 Databricks documentation states that it's model-dependent. https://docs.databricks.com/aws/en/resources/designated-services

I hope Databricks can clarify.

[Krishna_S · Accepted solution]

Hi @ChrisLawford_n1 

The Databricks Claude 3.7 for UKsouth, as you can see in the documentation, can only be used if it is supported based on GPU availability and requires cross-geo routing to be enabled, so cross-geo processing that allows data for Designated Services to be processed outside of their workspace Geo.

Azure foundation models databricks 

Also, in playground you can check this Claude Sonnet 3.7 model it will show the full details of it and shown in the image below, which shows it is a Databricks-hosted model 

Also, check this link regarding it: https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/supported-...