Terraform for Databricks

[Snoonan]

Hi all,

I can't find guidance on how to create a Databricks access connector for connecting catalogs to external data locations, using Terraform.

Also, I want to create my catalogs, set-up external locations etc using Terraform. Has anyone got a good resource for doing this and tips on how to go about it?

Thanks,

Sean

[Kaniz_Fatma]

Hi @Snoonan, Creating a Databricks access connector for connecting catalogs to external data locations using Terraform is a great way to manage your Databricks workspaces and associated cloud infrastructure.

Let’s break it down:

1. Databricks Access Connector with Terraform:

   • You can use the azurerm_databricks_access_connector resource in Terraform to manage your Databricks access connectors. Here’s an example usage:

     resource "azurerm_resource_group" "example" {
       name     = "example-resources"
       location = "West Europe"
     }
     
     resource "azurerm_databricks_access_connector" "example" {
       name               = "example-resource"
       resource_group_name = azurerm_resource_group.example.name
       location           = azurerm_resource_group.example.location
       identity {
         type = "SystemAssigned"
       }
       tags = {
         Environment = "Production"
       }
     }
     

   • The azurerm_databricks_access_connector resource allows you to specify the name, resource group, loc...¹.

2. Databricks Terraform Provider:

   • The Databricks Terraform provider supports all Databricks REST APIs, making it a powerful tool for automating complex aspects of deploying and managing your data platforms. You can use it to create workspaces, set up external locations, and manage access connectors².

3. Granting Access to Managed Identity:

   • In Terraform, you grant access to the managed identity assigned to the connector rather than directly to the connector itself. Assuming you use a system-assigned managed identity, you can expose it under the identity block in y...³.

4. Additional Resources:

   • For more details and examples, check out the official Terraform Registry documentation.
   • You can also explore other Terraform resources related to Databricks, such as virtual network peerin...⁴.

Remember to adapt the example code to your specific requirements, and feel free to ask if you need further assistance! 😊

[Snoonan]

Thank you,

This worked for me.