jessysantos
Databricks Employee
Databricks Employee

Hello @Michael_Galli 

The ai_gen uses the Mixtral-8x7B Instruct as its underlying Foundation model, which powers this and other AI functions as described in this doc: https://docs.databricks.com/en/sql/language-manual/functions/ai_gen.html#requirements

According to the error message you shared, it appears that your workspace does not have the Foundation Model APIs enabled. You should be able to verify this by checking your Serving page, where you should see the following endpoints:

Screenshot 2024-08-19 at 17.18.04.png

You can check more information regarding these endpoints in this doc: https://docs.databricks.com/en/machine-learning/foundation-models/index.html#pay-per-token-foundatio...

If you do not see these endpoint in the Serving UI, please reach out to your Databricks account team.

Best regards,

Jéssica Santos