Business Bench

Tasks · desk · Drafting

Q2 investor update letter from the KPI tracker

investor-update · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Please draft the Q2 investor update from finance's KPI tracker. Marcus's note says what goes in it. Save it as update.md.

Workspace

  • email_from_priya_finance.txt
  • investor_update_q1_2026.md
  • kpi_tracker_2026.xlsx
  • note_from_marcus.txt

Expected deliverables

  • update.md

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
update.md existsfile_existsyes0
quarter revenue figurestext_numbers_presentyes3
growth over Q1text_sentence_matchesyes0
end-of-June ARR, customers and cashtext_numbers_presentyes0
runwaytext_sentence_matchesyes0
unrestated Q2 total absenttext_not_containsyes0
confidential conversation not mentionedtext_not_containsyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash320.70.0087
Codex / GPT-5.6 sol001.00.2419

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "investor-update".