Hi @matte_kapa_bul , how are you doing?
First of all, congratulations on the initiative. I’ve tried to do something similar myself, and it’s very useful for locating documentation, but it doesn’t end up being very effective in solving some issues reported by community members. I ran some tests with real questions and, for example, there was a case where a service outage was reported, but in my tests this wasn’t the case — I even provided that response in the chat. Cases involving resource parameterization, environment differences, or different cloud providers are still complex for an LLM to accurately evaluate.