Terraform - Azure Databricks workspace without NAT gateway

[LauJohansson]

Hi all,

I have experienced an increase in costs - even when not using Databricks compute.

It is due to the NAT-gateway, that are (suddenly) automatically deployed.

When creating Azure Databricks workspaces using Terraform:

A NAT-gateway is created.

When I create the workspace using Azure Portal UI:

This is the resources: Managed Identity, Storage account, Access Connector for Azure Databricks, Network security group and Virtual network!

No NAT gateway is created!

How do I mirror the setup without a gateway?

Also see this medium post: https://medium.com/@optiman87/how-to-disable-nat-gateway-for-azure-databricks-11447015d917

[saurabh18cs]

try by adding more properties:

Also, Ensure that the subnets used by Azure Databricks do not have settings that require a NAT gateway.Consider using private endpoints for Azure Databricks to avoid the need for a NAT gateway.

  infrastructure_encryption_enabled = true

  public_network_access_enabled = false

  network_security_group_rules_required = "NoAzureDatabricksRules"

  custom_parameters {

    no_public_ip                                         = true

  }

  lifecycle {

    ignore_changes = [

      tags

    ]

  }