Databricks <> snowflake connectivity

[gopeshr]

We are trying to establish connection  between databricks and  snowflake through the databricks workspaces running on cluster. Initially we assumed it would be the firewall/network blocking the traffic and tried to add a firewall rule but even after we whitelisted the IP address on the either side (Databricks and Snowflake) and added the firewall rule we are still getting the same error. We need some assistance on what Databricks IP address needs to be whitelisted and how is DataBricks outbound traffic designed and want to establish connection. 

Attached screenshot for reference.

[Kaniz]

Hi @gopeshr , 

To connect Azure Databricks with Snowflake, you need to ensure the necessary network configurations and firewall rules are in place. Here's a brief guide:

1. Whitelist Databricks Public IP Addresses:

   • Obtain the list of Azure Databricks' public IP addresses from their documentation.
   • In Snowflake, whitelist these IP addresses by creating a network policy.
   • Replace 'DATABRICKS_PUBLIC_IP_ADDRESSES' with the actual list of Databricks IP addresses in the rule.

2. Configure VPC Peering or VPN:

   • If your Azure Databricks workspace and Snowflake account are in different VPCs, set up VPC peering or a VPN connection to enable private routing.

3. Verify Outgoing Traffic from Databricks:

   • Ensure there are no outbound restrictions on Azure Databricks that block traffic to Snowflake.
   • Test outgoing traffic from Databricks using tools like curl to check if it's not being blocked.

4. Check Snowflake Account Settings:

   • Confirm that your Snowflake account settings allow incoming traffic from Azure Databricks.
   • Use the SQL command provided to review network parameters in Snowflake.

By following these steps, you can establish a secure and reliable connection between Azure Databricks and Snowflake for seamless data integration and analysis.