topic Re: Connect to remote SQL Server (add databricks cluster IP to the whitelist) in Data Engineering

Connect to remote SQL Server (add databricks cluster IP to the whitelist)

IN — Thu, 05 Sep 2024 13:09:41 GMT

Hi,

I would need to connect from a notebook on workspaces to a remote SQL server instance. This server is protected by a firewall, thus I would need to add an IP address to the whitelist. Ideally, if it would be possible to setup/allocate static IP address for cluster/workspace so we wouldn't need to change it.

Can this be setup on databricks platform, or should I look for this on the GCP?

Thanks!

Re: Connect to remote SQL Server (add databricks cluster IP to the whitelist)

szymon_dybczak — Thu, 05 Sep 2024 13:25:37 GMT

Hi @IN ,

In Azure, you can deploy Workspace in VNET Injection mode and attach NAT Gateway to your VNET.

NAT GW require Public IP. This IP will be your static egress IP for all Cluster in for this Workspace.

I've never worked with GCP, but I think you can do similar thing. So you can configure a customer-managed VPC, and then configure egress to use Google Cloud NAT. And that NAT you can configure with static IP address.