Write this month's past-due reminders
The request
The task request supplied to the adapter, alongside the workspace below. Runtime instructions, authorized tools and skills also affect the system. Containerized runs withhold host-side references; local mode is not an isolation boundary.
Nadia's out, so please write this month's past-due payment reminders from the open invoice export - one file per customer in a reminders folder. Her guidelines are in the folder, and Dale's email has a couple of notes.
Workspace
- email_from_dale.txt
- open_invoices_2026-09-30.csv
- payment_plans.csv
- reminder_guidelines.md
Expected deliverables
- reminders/*.md
- reminders/*[Dd][Oo][Rr][Ss][Ee][Yy]*
- reminders/*[Rr][Ee][Dd][Ww][Oo][Oo][Dd]*
- reminders/*[Yy][Ee][Ll][Ll][Oo][Ww][Tt][Aa][Ii][Ll]*
This task also has a task-specific grader (check.py).
Recorded acceptance checks
The table uses check names and outcomes from the frozen campaign ledger. Acceptance requires all required predicates to pass; a predicate may itself contain a tolerance or coverage threshold. Its scope is part of the measurement contract.
| Recorded check | Type | Required | Failed / observed |
|---|---|---|---|
| reminder files | file_exists | yes | 0 / 6 |
| Redwood Property Mgmt reminder figures | text_numbers_present | yes | 0 / 6 |
| Yellowtail Seafood reminder figures | text_numbers_present | yes | 0 / 6 |
| Dorsey Freight credit hold paragraph | text_sentence_matches | yes | 0 / 6 |
| per-customer reminder facts | custom | yes | 3 / 6 |
Current task declaration (5 checks)
From task.yaml. Original runner grading and frozen retrospective scoring are separate. Read the frozen source for the rules behind the reported results.
- reminder files —
file_exists, required - Redwood Property Mgmt reminder figures —
text_numbers_present, required - Yellowtail Seafood reminder figures —
text_numbers_present, required - Dorsey Freight credit hold paragraph —
text_sentence_matches, required - per-customer reminder facts —
custom, required
Recorded results, desk release
| System | Repetitions | Frozen / 3 | Original / 3 | Median minutes | Mean model estimate (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.2 | 0.0165 | |
| Codex / GPT-5.6 sol | 0 | 0 | 1.8 | 0.2230 |
These are repeated executions on the released fixture, not independent new business cases. Cost is captured model usage priced under the recorded assumptions, excluding infrastructure and human review. Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "overdue-reminders".
Recorded results, desk comparison, 28 September 2026
| System | Repetitions | Frozen / 3 | Original / 3 | Median minutes |
|---|---|---|---|---|
| Proto / GPT-6 sol | 0 | 0 | 1.5 | |
| Codex / GPT-6 sol | 0 | 0 | 1.4 | |
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 1.3 |
A separate campaign under the same frozen scorer, not pooled with the release. Conditions and data.