https://community.databricks.com/t5/product-platform-updates/action-required-gcp-update-outbound-connectivity-for-classic/ba-p/70062 <P><STRONG>IMPORTANT NOTE: We have indefinitely delayed the automatic enforcement described below for workspaces that had enabled workspace IP access lists prior to July 29, 2024. We still recommend manually enforcing IP access lists on compute plane requests in these workspaces by taking the steps outlined below.&nbsp;</STRONG></P> <P><STRONG>Note: New IP access controls enabled on workspaces after July 29, 2024 are still enforced on data plane traffic, per the original communication below.</STRONG></P> <H2><SPAN>---------------------------------</SPAN></H2> <H2><SPAN>Communication</SPAN></H2> <P><SPAN>To enhance security, we are making a change to workspaces that use the </SPAN><A href="https://docs.gcp.databricks.com/en/security/network/front-end/ip-access-list.html" target="_blank" rel="noopener"><SPAN>workspace IP access lists</SPAN></A><SPAN> feature. For these workspaces, we will begin to apply workspace IP access controls to compute plane traffic. See </SPAN><I><SPAN>Action Required</SPAN></I><SPAN> and </SPAN><I><SPAN>Timeline</SPAN></I><SPAN> below for details.</SPAN></P> <P><STRONG>Action Required</STRONG></P> <P><SPAN>This change will impact all new workspaces on July 29 2024, and existing workspaces on August 26 2024.&nbsp;</SPAN></P> <P><SPAN>To ensure your compute plane can continue to talk to the Databricks control plane - take action to add the </SPAN><A href="https://cloud.google.com/nat/docs/set-up-manage-network-address-translation" target="_blank" rel="noopener"><SPAN>Public NAT</SPAN></A><SPAN> IP addresses to your </SPAN><A href="https://docs.gcp.databricks.com/en/security/network/front-end/ip-access-list-workspace.html" target="_blank" rel="noopener"><SPAN>workspace IP access list</SPAN></A><SPAN>. Step-by-step instructions are available below.</SPAN></P> <P><STRONG>Timeline</STRONG></P> <P><SPAN>The required actions must be taken by the following dates:</SPAN></P> <UL> <LI style="font-weight: 400;" aria-level="1"><SPAN>Starting on July 29 2024, </SPAN><STRONG>all new workspaces</STRONG><SPAN> that use </SPAN><A href="https://docs.gcp.databricks.com/en/security/network/front-end/ip-access-list.html" target="_blank" rel="noopener"><SPAN>workspace IP access lists</SPAN></A><SPAN> will begin enforcing workspace IP access lists on compute plane traffic</SPAN></LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>By August 26 2024, </SPAN><STRONG>all existing workspaces</STRONG><SPAN> that use </SPAN><A href="https://docs.gcp.databricks.com/en/security/network/front-end/ip-access-list.html" target="_blank" rel="noopener"><SPAN>workspace IP access lists</SPAN></A><SPAN> will begin enforcing workspace IP access lists on compute plane traffic</SPAN></LI> </UL> <H2><SPAN>Step-by-Step Instructions</SPAN></H2> <P><SPAN>Note: If your compute plane traffic egresses through a firewall/proxy appliance, ensure that the IPs of the appliance are added to the workspace IP ACL policy. If it does not, read on for Cloud NAT deployment.</SPAN></P> <OL> <LI style="font-weight: 400;" aria-level="1"><SPAN>Make sure your Cloud NAT is allocated a static public IP</SPAN> <OL> <LI style="font-weight: 400;" aria-level="1"><SPAN><SPAN>Please follow the instructions here:&nbsp;</SPAN></SPAN> <DIV dir="auto"><A href="https://cloud.google.com/nat/docs/set-up-manage-network-address-translation#specify_ip_addresses_for_nat" target="_blank" rel="noopener" data-saferedirecturl="https://www.google.com/url?q=https://cloud.google.com/nat/docs/set-up-manage-network-address-translation%23specify_ip_addresses_for_nat&amp;source=gmail&amp;ust=1716481093343000&amp;usg=AOvVaw3N5JARiEYf5jOAHtJ4W0TX">https://cloud.google.com/nat/<WBR />docs/set-up-manage-network-<WBR />address-translation#specify_<WBR />ip_addresses_for_nat</A>&nbsp;</DIV> </LI> </OL> </LI> <LI style="font-weight: 400;" aria-level="1"><SPAN>Retrieve IPs for cloud NAT</SPAN></LI> <OL> <LI style="font-weight: 400;" aria-level="1">Via GCP console&nbsp; <OL> <LI style="font-weight: 400;" aria-level="3"><SPAN>Go to <A href="https://console.cloud.google.com/net-services/nat/list?project=" target="_blank" rel="noopener">https://console.cloud.google.com/net-services/nat/list?project=</A>&lt;your_project_id&gt;</SPAN></LI> <LI style="font-weight: 400;" aria-level="3"><SPAN>Select the NAT gateway that is used by your workspace. If the workspace uses DB managed VPC, the NAT gateway will follow the naming pattern "databricks-&lt;workspace_id&gt;-nat"</SPAN></LI> <LI style="font-weight: 400;" aria-level="3"><SPAN>Find "Cloud NAT IP addresses"</SPAN></LI> <LI style="font-weight: 400;" aria-level="3"><SPAN>Copy the IP address&nbsp;</SPAN></LI> <LI style="font-weight: 400;" aria-level="3"><SPAN>If there are multiple NAT gateways deployed (e.g., for multiple zones), collect all IP addresses for the NAT gateway</SPAN></LI> </OL> </LI> <LI style="font-weight: 400;" aria-level="3"><SPAN>Via CLI (cloud shell)</SPAN> <OL> <LI><SPAN>Get the public IP resource ID</SPAN><LI-CODE lang="markup">gcloud compute routers describe &lt;NAME_OF_CLOUD_ROUTE&gt; --project=&lt;GCP_PROJECT_ID&gt; --region=&lt;REGION&gt; --format='get(nats[].natIps)' </LI-CODE></LI> <LI><SPAN>Get the public IP address from the resource</SPAN><LI-CODE lang="markup">gcloud compute addresses describe &lt;PUBLIC_IP_ADDRESS_NAME&gt; --project=&lt;GCP_RPOJECT_ID&gt; --region=&lt;REGION&gt; --format='get(address)'</LI-CODE></LI> </OL> </LI> </OL> </OL> <OL> <LI style="font-weight: 400;" aria-level="1"><SPAN>Add the NAT Gateway IP addresses to the workspace IP access list</SPAN></LI> <OL> <LI style="font-weight: 400;" aria-level="2"><SPAN>Follow the steps outlined here to add the IP addresses for the NAT gateways collected above to your workspace IP ACL policy: </SPAN><SPAN><BR /></SPAN><A href="https://docs.gcp.databricks.com/en/security/network/front-end/ip-access-list-workspace.html" target="_blank" rel="noopener"><SPAN>https://docs.gcp.databricks.com/en/security/network/front-end/ip-access-list-workspace.html</SPAN></A></LI> </OL> <LI style="font-weight: 400;" aria-level="1"><SPAN>Test that your deployment was successful</SPAN></LI> <OL> <LI style="font-weight: 400;" aria-level="2"><SPAN>Log in to your workspace</SPAN></LI> <LI style="font-weight: 400;" aria-level="2"><SPAN>Navigate to "Preview" &gt; "View All"&nbsp;</SPAN></LI> <LI style="font-weight: 400;" aria-level="2"><SPAN>Find "Enforce IP access list on Compute Plane Requests". On toggle on, IP ACL will be enforced on your NAT IP</SPAN></LI> <LI style="font-weight: 400;" aria-level="2"><SPAN>Wait for up to 10 minutes for the config to be applied to the workspace.</SPAN></LI> <LI style="font-weight: 400;" aria-level="2"><SPAN><SPAN>Create and run a python notebook with a new cluster of any type except serverless.</SPAN></SPAN> <P><SPAN>Cell #1&nbsp;</SPAN></P> <LI-CODE lang="markup">%pip install databricks-sdk --upgrade dbutils.library.restartPython() </LI-CODE> <P><SPAN>Cell #2</SPAN></P> <LI-CODE lang="markup">from databricks.sdk import WorkspaceClient w = WorkspaceClient() w.clusters.list() </LI-CODE><SPAN>If the code sample works, then your IP access list is set up correctly.</SPAN></LI> <LI style="font-weight: 400;" aria-level="2"><SPAN>In case of failures, toggle off "Enforce IP access list on Compute Plane Requests" to further troubleshoot. Wait for up to 10 minutes for the config to be applied to the workspace.</SPAN></LI> </OL> </OL> Wed, 16 Oct 2024 16:37:54 GMT AlexEsibov 2024-10-16T16:37:54Z https://community.databricks.com/t5/product-platform-updates/action-required-gcp-update-outbound-connectivity-for-classic/ba-p/70062 <P><SPAN>The following blog post details action required for workspaces that use workspace IP access lists.&nbsp;</SPAN><STRONG>The communication will also be sent out by email to users who Databricks determines might be affected.</STRONG></P> Wed, 16 Oct 2024 16:37:54 GMT https://community.databricks.com/t5/product-platform-updates/action-required-gcp-update-outbound-connectivity-for-classic/ba-p/70062 AlexEsibov 2024-10-16T16:37:54Z