topic Re: Not able to use tool type role with DBRX endpoint in Generative AI

Not able to use tool type role with DBRX endpoint

mayank_gupta — Wed, 22 May 2024 04:07:42 GMT

Error code: 404 - {'error_code': 'FEATURE_DISABLED', 'message': 'FEATURE_DISABLED: Tool Calling is not enabled for this workspace'}

Receiving this error when trying to complete chat using tools. How to enable tool calling feature?

I am posting for the first time. Please tell if any more information is required.

Re: Not able to use tool type role with DBRX endpoint

NandiniN — Tue, 21 May 2024 10:12:46 GMT

Hi @mayank_gupta ,

I checked internally on this. The endpoints need to support this capability. It seems likely that our model serving framework would need to accommodate tool calling.

I will ask the concerned team to check on this.

Thanks!

Re: Not able to use tool type role with DBRX endpoint

rpunuru — Fri, 24 May 2024 00:39:55 GMT

@NandiniN any update on this , i am also getting the same error for both bdrx and mixtral models

Re: Not able to use tool type role with DBRX endpoint

anand3 — Fri, 24 May 2024 09:45:36 GMT

If you encounter issues using the tool type role with the DBRX endpoint, ensure you have the correct permissions and configurations. clipping path image editing service Verify your access credentials and check for any updates or patches required for compatibility. Consult the official documentation or support for detailed troubleshooting steps and potential workarounds to resolve the problem efficiently.

Re: Not able to use tool type role with DBRX endpoint

anand22 — Fri, 24 May 2024 09:50:46 GMT

Re: Not able to use tool type role with DBRX endpoint

NandiniN — Sun, 26 May 2024 10:38:02 GMT

Hi @mayank_gupta @rpunuru ,

I could not get more information on the exact cause, but here are a few more pointers to check

- Are you trying from an unsupported region for External models?
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/model-serving-limits#--region-availability

- Also, from the internal discussion as mentioned earlier it looks like there is some work going on on this.

I have requested more info, and as I have details I can post further.

Re: Not able to use tool type role with DBRX endpoint

rpunuru — Sun, 26 May 2024 16:31:41 GMT

Thanks @NandiniN for response , It does work for regular q/a . Its an issue with only funciton/tool calling scenario. pls post when you find more information.

Re: Not able to use tool type role with DBRX endpoint

NandiniN — Thu, 06 Jun 2024 09:13:15 GMT

Hi Everyone, Tools is in private preview right now, there would be an official documentation later regarding its support.

If you have an Account SA, kindly reach out to them and they can guide you.

Re: Not able to use tool type role with DBRX endpoint

NandiniN — Fri, 21 Jun 2024 07:53:23 GMT

Latest here:

https://docs.databricks.com/en/machine-learning/model-serving/function-calling.html