cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

CloudFormation Stack Failure: Custom::CreateWorkspace in CREATE_FAILED State

Vanamaajay
New Contributor

I am trying to create a workspace using AWS CloudFormation, but the stack fails with the following error:

"The resource CreateWorkspace is in a CREATE_FAILED state. This Custom::CreateWorkspace resource is in a CREATE_FAILED state. Received response status [FAILED] from custom resource."

How can I resolve this issue? Any insights would be greatly appreciated.

1 REPLY 1

mark_ott
Databricks Employee
Databricks Employee

When a CloudFormation stack fails with โ€œThe resource CreateWorkspace is in a CREATE_FAILED stateโ€ for a Custom::CreateWorkspace resource, it typically means the Lambda or service backing the custom resource returned a FAILED signal to CloudFormation or failed to send a success signal in time. Most commonly, this is due to issues inside the Lambda function, misconfiguration, or permission problems.

Common Root Causes

  • The Lambda (or other backing service) failed due to an error (exception, misconfiguration, missing environment variables, etc.).โ€‹

  • The Lambda does not have the correct permissions (IAM policy issues) to perform its intended action, such as logging to CloudWatch (important for debugging).โ€‹

  • The Lambda does not signal completion correctly to CloudFormation (it must send a response with status SUCCESS or FAILED to a presigned S3 URL, usually using the cfn-response module or equivalent).โ€‹

  • The resource is attempting to create something that already exists, or there is a naming/resource conflict in the environment.โ€‹

  • Resource limits are exceeded, or required resources (like subnets, security groups, VPCs, or IAM roles) are missing or improperly referenced.โ€‹

  • If the Lambda runs out of memory or times out, CloudFormation will mark the custom resource as failed.โ€‹

How to Troubleshoot and Resolve

  • Review the CloudFormation Events tab in the AWS Console for error details and timestamps.

  • Check the Lambda functionโ€™s logs in CloudWatch for traceback, error messages, or missing permissions.

  • Confirm the Lambda functionโ€™s IAM role includes sufficient permissions for all AWS service actions it attempts, and permissions to write logs to CloudWatch.โ€‹

  • Ensure that the Lambda or backing service sends the CloudFormation Response using the correct format and destination URL (using the cfn-response library or similar mechanism).โ€‹

  • If using a third-party or partner template (such as Databricks workspaces), consult vendor-specific documentation and ensure any required prerequisites (network, resource quotas, subscriptions) are set up.โ€‹

  • Optionally, use the AWSSupport-TroubleshootCFNCustomResource runbook in AWS Systems Manager to analyze stack and custom resource errors efficiently.โ€‹

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now