Databricks cluster pool deployed through Terraform does not have UC enabled
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Tuesday
Hello everyone,
we have a workspace with UC enabled, we already have a couple of catalogs attached and when using our personal compute we are able to read/write tables in those catalogs.
However for our jobs we deployed a cluster pool using Terraform but those clusters don't seem to have UC enabled and thus cannot access our catalogs. Did someone ever run into this issue ?
Thank you
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Tuesday
Hi @erigaud,
Could you please share your cluster pool configuration?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Wednesday
try by adding this to your terraform code:
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thursday
Hello @Alberto_Umana @saurabh18cs thank you for replying, here is the configuration we're using in the terraform code :
resource "databricks_instance_pool" "instance_pool" {
instance_pool_name = "instance-pool-${var.environment}-${var.project}"
min_idle_instances = 0
max_capacity = 30
node_type_id = "Standard_DS3_v2"
idle_instance_autotermination_minutes = 30
disk_spec {
disk_size = 80
disk_count = 1
disk_type {
azure_disk_volume_type = "STANDARD_LRS"
}
}
}
Should we add something to this configuration so it works ?
Thanks !
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thursday - last edited Thursday
hi @erigaud
you should add this to databricks_job which is also using your instance pool.
example::