Hi @prakashhinduja , Adding to @ximenesfel points above, please find the below detailed links with explanation and demo of how to use RAG in databricks:

RAG in databricks: https://docs.databricks.com/aws/en/generative-ai/retrieval-augmented-generation
RAG glossary in databricks: https://www.databricks.com/glossary/retrieval-augmented-generation-rag
Best practices: https://www.databricks.com/blog/LLM-auto-eval-best-practices-RAG
Demo: https://app.getreprise.com/launch/dyRaj2X/
Rag with pine cone as vector database: https://www.databricks.com/blog/implementing-rag-chatbot-using-databricks-and-pinecone

These links will be helpful to go through these things and run the RAG code