Azure Databricks: Where are foundation models hosted

Rjdudley — Fri, 06 Jun 2025 13:17:29 GMT

In the updated Supported models for Databricks Foundation Models APIs - Azure Databricks | Microsoft Learn document, it's stated that Claude 3.7 and 4 Opus are " hosted by Databricks Inc. in AWS". Is that accurate for Azure Databricks, or is there an Azure endpoint also? If AWS is true, that's a problem for us.

There is no discussion of where the Meta Llama models are hosted. Are these also in AWS?

Re: Azure Databricks: Where are foundation models hosted

qlmahga2 — Sat, 07 Jun 2025 12:39:50 GMT

Claude is not hosted on Azure. Only Amazon Bedrock and Google Cloud's Vertex AI. Databricks hosts it through AWS within their security perimeter; i.e., requests go through Amazon Bedrock (Fig. 1), as indicated by the model name in AWS format and the response ID starting with the characteristic Bedrock models prefix `msg_bdrk_`.

There is no discussion of where the Meta Llama models are hosted. Are these also in AWS?

Based on the reference to Applicable model developer licenses and terms, I can assume they're hosted directly in Databricks. At least the request IDs have a different format from AWS (`chatcmpl_xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx`

topic Azure Databricks: Where are foundation models hosted in Generative AI

Azure Databricks: Where are foundation models hosted

Re: Azure Databricks: Where are foundation models hosted