topic Production Grade AI system with Agents capability in Databricks in Generative AI

Production Grade AI system with Agents capability in Databricks

Pratikmsbsvm — Thu, 10 Jul 2025 11:22:41 GMT

Design AI System for Customer Sentiments Analysis with Agentic Bot.

May someone please share how to architect such system in Databricks.

Infrastructure on Azure
Data Pipeline
Model Training
Model Testing
Choosing Best Model
Model Deployment
Model Consumtion

Please share your expertise on how to design from Data to AI to Model Deployment in Production

Do we also need Vector DB.

Kindly share your expertise.

Thanks a lot

Re: Production Grade AI system with Agents capability in Databricks

TheOC — Thu, 10 Jul 2025 14:09:49 GMT

hi @Pratikmsbsvm
That feels like a good sized project. My recommendation would be starting with a similar project and working from there. This might be a useful source for you to understand how this will look: https://www.databricks.com/blog/step-step-guide-ai-powered-customer-sentiment-analysis

I'd recommend you start with your steps laid out - get your infrastructure up, push your data into Databricks and then start looking to learn modelling.

Is there a particular part you're stuck on?