@pemidexx Thanks!

I would check out External Models and Mosaic AI Gateway as built-in options.

External models provides:

• Built-in support for major LLM providers (OpenAI, Anthropic, Cohere, etc.)
• Centralized credential management
• Unified endpoint interface
• Native integration with the rest of the Databricks platform

So you wouldn't need to run and maintain a separate proxy service.