Hello All,
I would like to report what appears to be an issue with one of the assessment questions in the Evaluating AI Agents course - Generative AI Engineer Pathway.
Question:
According to the lecture on evaluating AI agents, which of the following is described as a key reason why evaluation must be treated as a continuous process rather than a one-time validation step?
I selected the following answer:
"Production agents encounter diverse user queries, usage patterns change over time, and new failure modes emerge that were not anticipated during development."
This appears to be the correct answer based on the course content and the principles discussed in the lecture regarding continuous evaluation of AI agents. However, the platform marked this answer as incorrect and assigned a score of 0.
I have attached a screenshot showing the question, my selected answer, and the resulting feedback.
Did anyone face the same issue ?