topic Re: Cross region Databricks to SQL Connection in Data Engineering

Cross region Databricks to SQL Connection

Dbks_Community — Wed, 30 Nov 2022 20:38:17 GMT

We are trying to connect Azure Databricks Cluster to Azure SQL database but the firewalls at SQL level is causing an issue.

Whitelisting dbks subnet is not an option here as both the resources are in two different azure regions. Is there a secure way to achieve this requirement with this architecture. ?

Re: Cross region Databricks to SQL Connection

Aviral-Bhardwaj — Tue, 20 Dec 2022 14:22:28 GMT

this you can achieve via IAM role and IAM users

Re: Cross region Databricks to SQL Connection

Cedric — Fri, 27 Jan 2023 15:11:33 GMT

Hi @Timir Ranjan,

Have you tried looking into private endpoints? This allows you to expose your Azure SQL database from the Azure backbone and is cross-regional supported.

https://learn.microsoft.com/en-us/azure/private-link/private-endpoint-overview

Private endpoints enable connectivity between the customers from the same:
- Virtual network
- Regionally peered virtual networks
- Globally peered virtual networks
- On-premises environments that use VPN or Express Route
- Services that are powered by Private Link