topic Azure Databricks Serverless private connection to S3 bucket in Data Engineering

Azure Databricks Serverless private connection to S3 bucket

mgcasas-aws — Mon, 16 Jun 2025 22:50:01 GMT

I'm looking for technical references to connect an Azure Databricks serverless workspace to an S3 bucket over a private site-to-site VPN connection.

Found the following to connect AWS (consumer) to Azure (provider), but I'm looking for the other way.

https://community.databricks.com/t5/technical-blog/private-cross-cloud-delta-sharing-with-serverless-compute/ba-p/105719

Re: Azure Databricks Serverless private connection to S3 bucket

Sai_Ponugoti — Fri, 26 Sep 2025 15:39:25 GMT

Hello @mgcasas-aws
Thank you for your question!

We’re currently working on a solution for private cross-cloud Delta Sharing (Azure → AWS).

In the meantime, here’s a possible approach:

Update your Azure Storage Account network settings from private endpoints to “allow access from selected networks.”
From AWS Serverless, you can then obtain a stable NAT IP (PuPr) and whitelist those IPs on your Azure Storage Account.

This way, you can continue to leverage AWS Serverless compute while keeping your data in Azure private.
Please note: you’ll need to be enrolled in the preview to access NAT IPs for AWS Serverless.

Re: Azure Databricks Serverless private connection to S3 bucket

Venkatauppuluri — Thu, 21 May 2026 11:59:58 GMT

Hello @Sai_Ponugoti any progress on the solution?