Tasks · desk · Spreadsheet
Spring no-show rates by tutor under the 24-hour policy
appointment-no-shows · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Priyanka wants the spring no-show rates for each tutor, month by month, from the booking export. Save it as no_show_rates.csv; her note and the attendance policy are in the folder.
Workspace
- attendance_policy.txt
- bookings_export_2026-03-01_2026-05-31.csv
- no_show_rates_winter_term.csv
- note_from_owner.txt
Expected deliverables
- no_show_rates.csv
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| winter file columns | csv_columns | yes | 0 |
| every tutor | csv_set_equal | yes | 0 |
| one row per tutor and month | csv_row_count | yes | 0 |
| no-shows and rate per tutor and month | custom | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 1 | 1.5 | 0.0194 | |
| Codex / GPT-5.6 sol | 3 | 1 | 1.7 | 0.2325 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "appointment-no-shows".