topic Re: Model Serving Endpoint Creation through API in Machine Learning

Model Serving Endpoint Creation through API

pablobd — Tue, 09 Jan 2024 15:32:32 GMT

Hello,

I am trying to create a model serving endpoint via the API as explained here: https://docs.databricks.com/api/workspace/servingendpoints/create

I created a trusted IAM role with access to DynamoDB for the feature store. I try to use this field,

"instance_profile_arn": "arn:aws:iam:..."

But I get the following error:
b'{"error_code":"BAD_REQUEST","message":"IAM role arn:aws:iam:..." does not have the required trust relationship."}'

Any ideas? What does databricks expect of an IAM role so that it can be used by the model serving cluster?

Thanks

Re: Model Serving Endpoint Creation through API

Debayan — Sat, 20 Jan 2024 07:35:21 GMT

Hi, Could you please see if this is satisfied, https://docs.databricks.com/en/compute/sql-warehouse/data-access-configuration.html#confirm-or-set-up-an-aws-instance-profile-to-use-with-your-serverless-sql-warehouses

Re: Model Serving Endpoint Creation through API

pablobd — Tue, 23 Jan 2024 10:35:18 GMT

Thanks @Debayan - this article helped

Re: Model Serving Endpoint Creation through API

malanevans — Mon, 28 Oct 2024 05:36:37 GMT

I have a similar issue with a model serving endpoint I created for serving external models (Amazon Bedrock) with Mosaic AI model serving (https://docs.databricks.com/en/generative-ai/external-models/index.html). For this also, I can use an instance profile. I have added trust relationships as suggested to IAM role of the instance profile. Still I get this error.

Re: Model Serving Endpoint Creation through API

denys_t — Mon, 03 Feb 2025 04:04:10 GMT

Hi, any update on this? I am hosting bedrock in the separate account and configured Databricks to use cross-account setup with all necessary trust configured on both sides. Getting the same error with trust relationship

Re: Model Serving Endpoint Creation through API

denys_t — Mon, 03 Feb 2025 21:24:39 GMT

This was a missing piece for me to make the serving endpoint work with the instance profile. The JSON below needs to be added to the IAM role trust which is used for the instance profile:

{ "Effect": "Allow", "Principal": { "AWS": [ "arn:aws:iam::790110701330:role/serverless-customer-resource-role" ] }, "Action": "sts:AssumeRole" }

Re: Model Serving Endpoint Creation through API

EugeneBad — Thu, 30 Oct 2025 16:01:02 GMT

If you're using the databricks terraform provider, make sure the role's name matches the instance-profile name.

If not, use the `iam_role_arn` attribute to explicitly set the role's arn when creating the databricks instance profile

resource "databricks_instance_profile" "this" {
  instance_profile_arn = aws_iam_instance_profile.this.arn
  iam_role_arn         = aws_iam_role.this.arn
}

In addition to adding the databricks serverless role to the trust policy as others have stated above.