Business Bench

Tasks · desk · Reports

MRR by month and churn for the first half

mrr-report · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

The board pack needs our MRR month by month for the first half and what we lost to churn. Build it as mrr.xlsx with live formulas and write memo.md alongside it. Marcus's email says how he wants the subscriptions counted.

Workspace

  • email_from_finance.txt
  • opening_book_dec2025.xlsx
  • subscription_events_2026.csv

Expected deliverables

  • memo.md
  • mrr.xlsx

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
mrr.xlsx existsfile_existsyes0
live formulasxlsx_has_formulasyes0
no error cellsxlsx_no_errorsyes0
March ending MRRxlsx_value_presentyes1
June ending MRRxlsx_value_presentyes1
churned MRR in Mayxlsx_value_presentyes2
churned MRR for the halfxlsx_value_presentyes1
memo carries the June MRR and the churn figuretext_numbers_presentyes0
memo names the month the churn landed intext_sentence_matchesyes1

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash1110.10.1212
Codex / GPT-5.6 sol118.90.9275

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "mrr-report".