topic Re: Agents and Inference table errors in Get Started Discussions

Agents and Inference table errors

Sangamswadik — Mon, 03 Mar 2025 05:03:02 GMT

Hi, I'm trying to deploy a rag model from GCP databricks. I've added an external gpt4o endpoint and enabled inference table in settings. But when Im trying to deploy agents I'm still getting the inference table not enabled error. (I've registered the model in unity catalog). I've looked in workspace settings and elsewhere, I could not find any option to enable inference tables.

Re: Agents and Inference table errors

MariuszK — Mon, 03 Mar 2025 14:05:10 GMT

Hi,

Which region do you use? I remember that there were some limitations for RAG implementation in GCP. Did you try to test it with Langchain to just past a prompt?
I tested in in Azure and it works without any problems.

Re: Agents and Inference table errors

Sangamswadik — Mon, 03 Mar 2025 14:54:54 GMT

Hi, I'm in us-east-1 (the public preview). Thanks! I wasn't aware that there were limitations. I was trying to run the code provided on AI cookbook (implement rag on your own data)

https://ai-cookbook.io/nbs/6-implement-overview.html

I also noticed that there is no apps functionality as well.

Re: Agents and Inference table errors

MariuszK — Mon, 03 Mar 2025 15:10:41 GMT

The Model Serving is supported in your region so it can be another problem or limitation.

Re: Agents and Inference table errors

Sangamswadik — Mon, 03 Mar 2025 15:18:27 GMT

yes it is supported But I've been seeing some weird things when running code such as artifacts getting registered but without versions, and cannot serve them without versions etc.

Thanks anyway.