Custom Endpoints for AI functions In Databricks

Avinash_Narala · ‎07-10-2024

Hi Community.

Recently I gone through the AI Functions and amazed by the results.

I just wanted to know whether can we use our custom endpoints(instead of databricks foundational models) and leverage this AI Functions(ai_classify, ai_mask, etc)

https://docs.databricks.com/en/large-language-models/ai-functions.html

Avinash_Narala · ‎07-12-2024

Hi @Retired_mod ,

I'm glad for your response.

But In Databricks Documentation I found that underlying, foundational models are used.

And I didn't find anywhere that I can leverage endpoints for these functions.

I'm very happy to test if it is possible, can you please guide me how to implement in databricks workspace hosted on AWS.