- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-19-2024 01:32 PM
Hello @Michael_Galli
The ai_gen uses the Mixtral-8x7B Instruct as its underlying Foundation model, which powers this and other AI functions as described in this doc: https://docs.databricks.com/en/sql/language-manual/functions/ai_gen.html#requirements
According to the error message you shared, it appears that your workspace does not have the Foundation Model APIs enabled. You should be able to verify this by checking your Serving page, where you should see the following endpoints:
You can check more information regarding these endpoints in this doc: https://docs.databricks.com/en/machine-learning/foundation-models/index.html#pay-per-token-foundatio...
If you do not see these endpoint in the Serving UI, please reach out to your Databricks account team.
Best regards,
Jéssica Santos