cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Model Serving Endpoint Creation through API

pablobd
Contributor II

Hello,

I am trying to create a model serving endpoint via the API as explained here: https://docs.databricks.com/api/workspace/servingendpoints/create

I created a trusted IAM role with access to DynamoDB for the feature store. I try to use this field,

"instance_profile_arn": "arn:aws:iam:..."
 
But I get the following error:
b'{"error_code":"BAD_REQUEST","message":"IAM role arn:aws:iam:..." does not have the required trust relationship."}'
 
Any ideas? What does databricks expect of an IAM role so that it can be used by the model serving cluster?

Thanks
1 ACCEPTED SOLUTION

Accepted Solutions

pablobd
Contributor II

Thanks @Debayan - this article helped

View solution in original post

3 REPLIES 3

Debayan
Databricks Employee
Databricks Employee

pablobd
Contributor II

Thanks @Debayan - this article helped

malanevans
New Contributor II

I have a similar issue with a model serving endpoint I created for serving external models (Amazon Bedrock) with Mosaic AI model serving (https://docs.databricks.com/en/generative-ai/external-models/index.html). For this also, I can use an instance profile. I have added trust relationships as suggested to IAM role of the instance profile. Still I get this error.

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group