Announcement for the wine club harvest dinner
event-announcement · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Can you write the announcement for the wine club harvest dinner so I can send it to members? The planning sheet and Sofia's email thread are in the folder. Save it as announcement.md.
Workspace
- announcement_spring_release_party_2026.md
- email_thread_harvest_dinner.txt
- harvest_dinner_2026_planning.xlsx
Expected deliverables
- announcement.md
This task also has a task-specific grader (check.py).
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| announcement.md exists | file_exists | yes | 0 |
| dates and seating | custom | yes | 0 |
| pavilion address | text_matches_all | yes | 0 |
| seated capacity | text_sentence_matches | yes | 0 |
| ticket prices | text_numbers_present | yes | 0 |
| spring party details absent | text_not_contains | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 0.5 | 0.0081 | |
| Codex / GPT-5.6 sol | 3 | 3 | 0.9 | 0.1529 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "event-announcement".