cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks <> snowflake connectivity

gopeshr
New Contributor

We are trying to establish connection  between databricks and  snowflake through the databricks workspaces running on cluster. Initially we assumed it would be the firewall/network blocking the traffic and tried to add a firewall rule but even after we whitelisted the IP address on the either side (Databricks and Snowflake) and added the firewall rule we are still getting the same error. We need some assistance on what Databricks IP address needs to be whitelisted and how is DataBricks outbound traffic designed and want to establish connection. 

 

Attached screenshot for reference.

gopeshr_1-1698199098184.png

 

 

1 REPLY 1

Kaniz
Community Manager
Community Manager

Hi @gopeshr , 

To connect Azure Databricks with Snowflake, you need to ensure the necessary network configurations and firewall rules are in place. Here's a brief guide:

  1. Whitelist Databricks Public IP Addresses:

    • Obtain the list of Azure Databricks' public IP addresses from their documentation.
    • In Snowflake, whitelist these IP addresses by creating a network policy.
    • Replace 'DATABRICKS_PUBLIC_IP_ADDRESSES' with the actual list of Databricks IP addresses in the rule.
  2. Configure VPC Peering or VPN:

    • If your Azure Databricks workspace and Snowflake account are in different VPCs, set up VPC peering or a VPN connection to enable private routing.
  3. Verify Outgoing Traffic from Databricks:

    • Ensure there are no outbound restrictions on Azure Databricks that block traffic to Snowflake.
    • Test outgoing traffic from Databricks using tools like curl to check if it's not being blocked.
  4. Check Snowflake Account Settings:

    • Confirm that your Snowflake account settings allow incoming traffic from Azure Databricks.
    • Use the SQL command provided to review network parameters in Snowflake.

By following these steps, you can establish a secure and reliable connection between Azure Databricks and Snowflake for seamless data integration and analysis.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!