- 808 Views
- 2 replies
- 0 kudos
Resolved! MLFlow tracking from Azure Container Instance
Hi everyone,we're building a voice chatbot for a customer using a mix of technologies — Databricks, Azure AI Foundry, and a few external containerized services.Currently, we're tracking requests and logs via Lakebase with custom traces, but I'm now e...
- 808 Views
- 2 replies
- 0 kudos
- 0 kudos
Similar response to the one from WorksBuddy. Short answer: yes, it's supported, and there's a specific Databricks guide for your case. The tutorial you found is for local/IDE; the production-container equivalent is here: Trace agents deployed out...
- 0 kudos
- 1245 Views
- 1 replies
- 1 kudos
Resolved! How to get MLflow OpenAI autolog traces from PySpark mapInPandas workers (and some pitfalls)
ContextI'm running an LLM pipeline on Databricks that distributes OpenAI API calls across Spark workers via mapInPandas. Getting mlflow.openai.autolog() to work on workers required solving three undocumented issues. Sharing here since I couldn't find...
- 1245 Views
- 1 replies
- 1 kudos
- 1 kudos
Greetings @Jayachithra , I did some digging and came up with some helpful tips/hints to help you along. On Issue 1 (explicit MLflow context): expected behavior once you realize that mapInPandas spawns isolated Python worker processes, not threads. ...
- 1 kudos