Tasks · desk · Extraction
Log this year's grant award letters into the tracker
grant-award-letters · timeout 1800 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Go through the funder letters in the folder and put the key details of every grant into grants.csv, one row per grant. Dana's note has the columns I need.
Workspace
- funder_letters/Alder_Family_Foundation_award.pdf
- funder_letters/Granite_Peak_Foundation_response.pdf
- funder_letters/HarborTrust_grant_letter.pdf
- funder_letters/Meridian_Health_Fdn_notice_of_award.pdf
- funder_letters/Sycamore-Fund-2026-award.pdf
- funder_letters/WillowCreek_amendment_letter.pdf
- funder_letters/WillowCreek_original_award_2026-05.pdf
- funder_letters/scan_northgate_letter.pdf
- note_from_dana.txt
Expected deliverables
- grants.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| one row per awarded grant | csv_set_equal | yes | 0 |
| row count | csv_row_count | yes | 0 |
| funder names | csv_values_match | yes | 0 |
| award amounts | csv_values_match | yes | 0 |
| grant period | csv_values_match | yes | 0 |
| report due dates | csv_values_match | yes | 0 |
| declined request absent | text_not_contains | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 1 | 1.1 | 0.0111 | |
| Codex / GPT-5.6 sol | 3 | 0 | 1.4 | 0.1911 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "grant-award-letters".