Possible Incorrect Answer Marking in Databricks Academy Assessment - Agent Evaluation on Databricks

[Dhivakar_sathya]

Hello All,

I would like to report what appears to be an issue with one of the assessment questions in the Evaluating AI Agents course - Generative AI Engineer Pathway.

Question:

According to the lecture on evaluating AI agents, which of the following is described as a key reason why evaluation must be treated as a continuous process rather than a one-time validation step?

I selected the following answer:

"Production agents encounter diverse user queries, usage patterns change over time, and new failure modes emerge that were not anticipated during development."

This appears to be the correct answer based on the course content and the principles discussed in the lecture regarding continuous evaluation of AI agents. However, the platform marked this answer as incorrect and assigned a score of 0.

I have attached a screenshot showing the question, my selected answer, and the resulting feedback.

Did anyone face the same issue ?

[Advika]

Hello @Dhivakar_sathya, thanks for flagging this!

To report this question, please raise a ticket with the Databricks Support team. In the ticket, please include the screenshot along with the option you believe is correct and the basis for your selection.

The Support team will be able to look into this and assist you further.

[Dhivakar_sathya]

@Advika i have raised the same, acknowlegded as below  

Hi Dhivakar,

 Thanks for contacting the Databricks Training team. Your request #00995431 has been received. We are looking into your question regarding Possible Incorrect Answer Marking in Databricks Academy Assessment - Quiz - Agent Evaluation on Databricks and will have an update for you shortly.If you have any concerns or additional queries please reply back to this email.

Best Regards,

Databricks Support