Hi, this looks like a real quirk in agent mode benchmark scoring, not something you're doing wrong on the setup side.

Chat mode benchmarks grade by comparing Genie's generated SQL result set against your SQL ground truth, so "Empty result" there means the query genuinely returned nothing. Agent mode works completely differently: there's no SQL comparison at all, an LLM judge reads the whole agent report (text summary, tables, citations) and grades it against your Evaluation note. Since agent mode responses come back as a report rather than a clean result set, it's plausible the judge is failing to parse a result out of that report format in some cases and defaulting to "Empty result" even when the report clearly has an answer in it. That would explain why you're seeing it on outputs that already match ground truth.