Custom Endpoints for AI functions In Databricks

[Avinash_Narala]

Hi Community.

Recently I gone through the AI Functions and amazed by the results.

I just wanted to know whether can we use our custom endpoints(instead of databricks foundational models) and leverage this AI Functions(ai_classify, ai_mask, etc)

https://docs.databricks.com/en/large-language-models/ai-functions.html

[Kaniz_Fatma]

Hi @Avinash_Narala, I’m glad to hear that you’re excited about AI Functions in Databricks. 

The article provides more details on setting up web endpoints for use with Custom Commands in Azure. While this is specific to Azure, the general principles of integrating custom endpoints would apply to the Databricks AI Functions as well. So in summary, yes you can leverage the Databricks AI Functions with your own custom endpoints, allowing you to integrate them with your own applications and data sources.

[Avinash_Narala]

Hi @Kaniz_Fatma  ,

I'm glad for your response.

But In Databricks Documentation I found that underlying, foundational models are used.

And I didn't find anywhere that I can leverage endpoints for these functions.

I'm very happy to test if it is possible, can you please guide me how to implement in databricks workspace hosted on AWS.