This week's orders page for the packing bench
orders-status-page · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Hana wants this week's orders as a page for the packing-bench laptop - her note has what goes on it. Please save it as index.html.
Workspace
- note_from_hana.txt
- orders_export_2026-08-31_to_2026-09-06.csv
- orders_export_2026-09-07_to_2026-09-13.csv
Expected deliverables
- index.html
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| index.html exists | file_exists | yes | 0 |
| every order listed | text_contains_all | yes | 0 |
| test orders left off | text_not_contains | yes | 1 |
| revenue this week | text_numbers_present | yes | 0 |
| page structure | custom | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 2 | 2 | 4.5 | 0.0489 | |
| Codex / GPT-5.6 sol | 3 | 3 | 3.4 | 0.3764 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "orders-status-page".