Tasks · desk · Spreadsheet
Stock valued at cost by department for the accountant
inventory-valuation · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Frank needs our stock valued at cost by department as of 30 September for the accountant. Save it as valuation.xlsx with live formulas - his note explains the counts and the costs.
Workspace
- note_from_frank.txt
- purchasing_receipts_2026.xlsx
- stock_on_hand_2026-09-30.csv
Expected deliverables
- valuation.xlsx
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| valuation.xlsx exists | file_exists | yes | 0 |
| live formulas | xlsx_has_formulas | yes | 0 |
| no error cells | xlsx_no_errors | yes | 0 |
| Trees value (latest receipt cost) | xlsx_value_present | yes | 0 |
| Shrubs value (negative counts at zero) | xlsx_value_present | yes | 0 |
| Pots & Planters value (loosely typed SKUs) | xlsx_value_present | yes | 0 |
| total stock value | xlsx_value_present | yes | 0 |
| items without a cost are flagged | custom | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 4.7 | 0.0579 | |
| Codex / GPT-5.6 sol | 3 | 3 | 7.8 | 0.6952 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "inventory-valuation".