Tasks · desk · Extraction
Match this week's packing slips to the open POs
packing-slips-vs-po · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Can you check this week's packing slips against our open purchase orders and give me receipts.csv? The receiving note says what purchasing needs on it.
Workspace
- note_from_receiving.txt
- open_purchase_orders.xlsx
- packing_slips/Cascadia_PS_362674_backorder.pdf
- packing_slips/Cascadia_PS_938234.pdf
- packing_slips/Summit_packing_list_949574.pdf
- packing_slips/scan_0904_slip.pdf
- packing_slips/trailhead_packlist_658433.pdf
Expected deliverables
- receipts.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| one row per PO line | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| SKUs and ordered quantities | csv_values_match | yes | 0 |
| received quantities | csv_values_match | yes | 0 |
| substitutions | csv_values_match | yes | 0 |
| line status | csv_values_match | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.7 | 0.0206 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.2 | 0.1910 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "packing-slips-vs-po".