Dabricks AI Gateway (Beta)

[sudarshank]

Are you managing multiple LLMs on Databricks with no visibility or control? If the answer is Yes, don't worry, you are not alone. I have been in multiple discussion and got the same question about managing multiple LLMs in one place.

Now, we have Databricks AI Gateway (in beta). Get more info from this url: https://docs.databricks.com/aws/en/ai-gateway/

I have created a video where I break down Databricks AI Gateway -> the central control plane for governing LLMs and coding agents like Claude Code, Cursor, and Codex CLI.

Here is what you'll learn:

✅ What AI Gateway is and why it matters

✅ Permissions, Rate Limits, Observability & Inference Tables explained

✅ How to query AI Gateway using the OpenAI Python client

Video link: https://youtu.be/oP1E-ulWl8k?si=PeH6Y9KKoDYma_6Y