Tasks · desk · Extraction
Key the September venue invoices into job costing
venue-invoices · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
The venue invoices for our September events are in the folder. Can you key them into venue_lines.csv for job costing? Tamsin's note explains how she wants it laid out.
Workspace
- event_list.csv
- note_from_tamsin.txt
- venue_invoices/Foundry_CooperRiver_FCR-2026-0418.pdf
- venue_invoices/Harborview_HTH-51573-R1.pdf
- venue_invoices/Harborview_HTH-51573.pdf
- venue_invoices/MagnoliaHall_invoice_7779.pdf
- venue_invoices/Rosewater_RG-26-0911.pdf
- venue_invoices/scan_oldmillbarn_0901.pdf
Expected deliverables
- venue_lines.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| one row per invoice line | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| event codes and invoice numbers | csv_values_match | yes | 0 |
| invoice dates | csv_values_match | yes | 0 |
| descriptions | csv_values_match | yes | 0 |
| line types | csv_values_match | yes | 0 |
| amounts | csv_values_match | yes | 0 |
| line tax | csv_values_match | yes | 0 |
| balance due | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.2 | 0.0175 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.9 | 0.2200 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "venue-invoices".