Schedule change notices for next week's revised rota
schedule-change-notices · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
WFM put out a revised schedule for the week of 9/21. Please write the change notices for the agents it affects; Renata's email has the rules. Put them in a notices folder.
Workspace
- agent_roster.csv
- email_from_renata.txt
- schedule_week_2026-09-21_published.xlsx
- wfm_shift_export_week38_rev2.csv
Expected deliverables
- notices/*[eE][dD][wW][aA][rR][dD]*[wW][aA][rR][dD]*
- notices/*[jJ][oO][sS][hH][uU][aA]*[sS][cC][oO][tT][tT]*
- notices/*[kK][aA][rR][eE][nN]*[aA][lL][lL][eE][nN]*
- notices/*[rR][yY][aA][nN]*[yY][oO][uU][nN][gG]*
- notices/*[sS][tT][eE][pP][hH][aA][nN][iI][eE]*[rR][aA][mM][oO][sS]*
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| notice for Karen Allen | file_exists | yes | 0 |
| notice for Joshua Scott | file_exists | yes | 0 |
| notice for Edward Ward | file_exists | yes | 0 |
| notice for Stephanie Ramos | file_exists | yes | 0 |
| notice for Ryan Young | file_exists | yes | 0 |
| notices carry their own changes | custom | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 2 | 1.8 | 0.0260 | |
| Codex / GPT-5.6 sol | 3 | 2 | 1.9 | 0.3460 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "schedule-change-notices".