Q2 sales by territory from the monthly exports
regional-sales-monthly · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Ramona needs the Q2 sales by territory - territories down the side, months across - from the monthly exports in this folder. Save it as regional.xlsx with live formulas, plus memo.md with what she should know. Her note says how she counts them.
Workspace
- note_from_ramona.txt
- sales_2026-03.csv
- sales_2026-04.csv
- sales_2026-05.csv
- sales_2026-06.csv
Expected deliverables
- memo.md
- regional.xlsx
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| regional.xlsx exists | file_exists | yes | 0 |
| live formulas | xlsx_has_formulas | yes | 0 |
| no error cells | xlsx_no_errors | yes | 0 |
| Atlantic quarter total | xlsx_value_present | yes | 0 |
| Mountain quarter total (two months, no invented May) | xlsx_value_present | yes | 0 |
| Pacific May (duplicate rows and a credit memo) | xlsx_value_present | yes | 0 |
| quarter total, all territories | xlsx_value_present | yes | 0 |
| memo carries the quarter and Mountain totals | text_numbers_present | yes | 0 |
| memo says Mountain is missing from the May export | text_sentence_matches | yes | 1 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 11.2 | 0.1055 | |
| Codex / GPT-5.6 sol | 2 | 2 | 5.5 | 0.6851 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "regional-sales-monthly".