- 217 Views
- 1 replies
- 0 kudos
MLFlow tracking from Azure Container Instance
Hi everyone,we're building a voice chatbot for a customer using a mix of technologies — Databricks, Azure AI Foundry, and a few external containerized services.Currently, we're tracking requests and logs via Lakebase with custom traces, but I'm now e...
- 217 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey Alessandro,1. Technically feasible? Yes.MLflow's tracking client is just HTTP. As long as your container can reach the Databricks-managed MLflow endpoint, you can send traces from anywhere. Set your workspace host and token as environment variabl...
- 0 kudos
- 914 Views
- 1 replies
- 1 kudos
Resolved! How to get MLflow OpenAI autolog traces from PySpark mapInPandas workers (and some pitfalls)
ContextI'm running an LLM pipeline on Databricks that distributes OpenAI API calls across Spark workers via mapInPandas. Getting mlflow.openai.autolog() to work on workers required solving three undocumented issues. Sharing here since I couldn't find...
- 914 Views
- 1 replies
- 1 kudos
- 1 kudos
Greetings @Jayachithra , I did some digging and came up with some helpful tips/hints to help you along. On Issue 1 (explicit MLflow context): expected behavior once you realize that mapInPandas spawns isolated Python worker processes, not threads. ...
- 1 kudos