cancel
Showing results for 
Search instead for 
Did you mean: 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results for 
Search instead for 
Did you mean: 

Clarification on Databricks Claude 3.7 Sonnet native serving endpoint data processing location.

ChrisLawford_n1
Contributor

Hello, 

I am trying to clarify if Databricks Claude 3.7 Native serving endpoint is safe for use in our enterprise or if it needs to be disabled.
I am trying to understand if the data sent to this endpoint is kept within our geo region (UKSouth/Europe). From the documentation I can see that databricks-claude-3.7-sonnet is available as a databricks hosted foundation model but only if I enable cross geography routing.(Supported foundation models on Mosaic AI Model Serving - Azure Databricks | Microsoft Learn)  

ChrisLawford_n1_0-1753277934139.png

This implies to me that the model involves sending the data outside of our region. 
Currently we are have cross-geo disabled and are able to use Claude-3.7 in the AI playground, this is where my understanding is confused.
If I can only make another serving endpoint using claude-3.7 if I enable cross-geo, how is it that the native claude-3.7 endpoint is able to work when this is disabled.

Ideally I am looking for some documentation to tell me that the native claude-3.7 is hosted on databricks in my region and that it is not an external model that would mean that the data could be being sent outside the region.

1 REPLY 1

Sharanya13
Contributor III

@ChrisLawford_n1 Databricks documentation states that it's model-dependent. https://docs.databricks.com/aws/en/resources/designated-services

I hope Databricks can clarify.