topic Can you manage Workspaces using Terraform on an AWS Standard Tier account. in Data Engineering

Can you manage Workspaces using Terraform on an AWS Standard Tier account.

alan_cooper — Tue, 21 Jun 2022 14:18:53 GMT

Background: I am looking to migrate a small PoC Databricks workspace in Azure over to a productionised deployment in AWS.

I need to deploy all the Workspaces and all the notebooks etc code in those workspaces using a CI/CD pipeline, using Terraform to manage the infrastructure elements.

I can get this up and running using a Cloudformation-based quickstart, which adds in a new VPC, roles etc using Cloudformation Custom resources, but I am required to move this to a terraform deployment.

I have most of the Terraform deployment working as per https://registry.terraform.io/providers/databrickslabs/databricks/latest/docs/guides/aws-workspace, but I am unable to deploy the databricks_mws_networks - I've not been able to clarify what the requirement is for Premium subscription for the MWS Network piece - can anyone help?

Error: cannot create mws networks: PERMISSION_DENIED: Feature cannot be accessed. Account 15552fd5-2b5c-4506-a412-6de469xxxxxx does not have one of required pricing tier(s) PREMIUM, ENTERPRISE

Re: Can you manage Workspaces using Terraform on an AWS Standard Tier account.

alan_cooper — Mon, 27 Jun 2022 15:30:05 GMT

Hi Kaniz,

Thanks for getting back to me - I'd really like to understand why I need Premium to use Terraform when I can deploy the same end set up manually or through Cloudformation on Standard subscription?

I do appreciate the additional functionality on Premium, but at this point in time, I don't need those features.

Regards,

Alan

Re: Can you manage Workspaces using Terraform on an AWS Standard Tier account.

Vidula — Sat, 27 Aug 2022 04:56:58 GMT

Hi @ALAN COOPER

I hope all is well! I just wanted to check in if you were able to resolve your issue would you be happy to mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!