Tasks · desk · Extraction
Key the July and August bank statements into the transactions file
bank-statement-pdf · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Please get July and August off the bank statements and into transactions.csv, set up like the June file. Everything's in the folder, including a note on how I did June.
Workspace
- note.txt
- statements/CascadeCU_stmt_2026-07.pdf
- statements/HarborTrust_BusinessChecking_Aug2026.pdf
- statements/scan_northgate_savings_jul-aug.pdf
- transactions_2026-06.csv
Expected deliverables
- transactions.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| June file columns | csv_columns | yes | 0 |
| one row per transaction | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| accounts and dates | csv_values_match | yes | 0 |
| descriptions | csv_values_match | yes | 0 |
| amounts | csv_values_match | yes | 0 |
| running balances | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 2.3 | 0.0262 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.6 | 0.2897 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "bank-statement-pdf".