topic Re: Azure Databricks Assistant and Private Link in Administration & Architecture

Azure Databricks Assistant and Private Link

Matt4 — Wed, 31 Jan 2024 14:53:08 GMT

Hi,

I was wondering if anyone is using the Databricks Assistant using the standard private link configuration of their network.

Kind of curious how data is passed from the Databricks Workspace, in a private link configuration, to the Azure OpenAI service, that the assistant is using. And curious how that is secured (or not), assuming it is sending the metadata over the internet somehow and from somewhere. Trying to understand the level of risk and change required to make the assistant work.

Any insight would be great, can't find any documentation to describe how this works

Thanks in advance

Re: Azure Databricks Assistant and Private Link

Yeshwanth — Thu, 01 Feb 2024 07:20:16 GMT

@Matt4 please check this https://www.databricks.com/blog/introducing-databricks-assistant

Let us know if it helps.

Re: Azure Databricks Assistant and Private Link

Matt4 — Thu, 01 Feb 2024 07:59:46 GMT

I kind of know how it works (which is what that blog details) and the types of data it is using.

I am after the specifics of the network configurations on Azure OpenAI and Azure Databricks in a private link configuration

Re: Azure Databricks Assistant and Private Link

Yeshwanth — Fri, 02 Feb 2024 07:07:57 GMT

@Matt4 okay, we might need to check this with the Azure Network team?

Re: Azure Databricks Assistant and Private Link

Matt4 — Tue, 06 Feb 2024 11:32:29 GMT

I asked our SA at Databricks. AWS is different if anyone is looking for that answer

Azure Open AI connects to the control plane
It doe not use private endpoints, though since you are an Azure customer, the traffic stays on the Azure global network (no public internet).