Tasks · desk · Bookkeeping
Code August company-card charges to the ledger by item type
card-expense-coding · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Please code August's company card charges to our accounts following the card policy, and give me coded.csv for the import plus review.csv with everything I need to look at. Everything you need is in the folder.
Workspace
- approved_travel_2026-08.csv
- card_policy_2026.md
- card_transactions_2026-08.csv
- coding_import_template.csv
Expected deliverables
- coded.csv
- review.csv
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| import columns | csv_columns | yes | 0 |
| one row per charge | csv_row_count | yes | 0 |
| every posted charge coded | csv_set_equal | yes | 0 |
| gl accounts | csv_values_match | yes | 0 |
| employee owes | custom | yes | 0 |
| review list | custom | yes | 0 |
| review list says why | csv_columns | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.7 | 0.0220 | |
| Codex / GPT-5.6 sol | 3 | 3 | 2.9 | 0.3468 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "card-expense-coding".