cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Agents and Inference table errors

Sangamswadik
New Contributor III

Hi, I'm trying to deploy a rag model from GCP databricks. I've added an external gpt4o endpoint and enabled inference table in settings. But when Im trying to deploy agents I'm still getting the inference table not enabled error. (I've registered the model in unity catalog). I've looked in workspace settings and elsewhere, I could not find any option to enable inference tables. 

Sangamswadik_0-1740977753362.png

Sangamswadik_1-1740978040054.png

 

1 ACCEPTED SOLUTION

Accepted Solutions

MariuszK
Contributor III

The Model Serving is supported in your region so it can be another problem or limitation.

View solution in original post

4 REPLIES 4

MariuszK
Contributor III

Hi,

Which region do you use? I remember that there were some limitations for RAG implementation in GCP.  Did you try to test it with Langchain to just past a prompt?
I tested in in Azure and it works without any problems.

Hi, I'm in us-east-1 (the public preview). Thanks! I wasn't aware that there were limitations. I was trying to run the code provided on AI cookbook (implement rag on your own data)

https://ai-cookbook.io/nbs/6-implement-overview.html

I also noticed that there is no apps functionality as well. 

MariuszK
Contributor III

The Model Serving is supported in your region so it can be another problem or limitation.

yes it is supported But I've been seeing some weird things when running code such as artifacts getting registered but without versions, and cannot serve them without versions etc. 

Thanks anyway.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now