Business Bench

Tasks · desk · Spreadsheet

Door list for the author evening

event-attendee-merge · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Thursday's author evening needs a final door list from the online tickets, the paper sign-up sheet and the waitlist. Nadia's emails say who is in. Save it as attendees.csv.

Workspace

  • email_thread_door_list.txt
  • eventbrite_attendees_report.csv
  • signup_sheet_at_till.xlsx
  • waitlist_form_responses.csv

Expected deliverables

  • attendees.csv

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
requested columnscsv_columnsyes0
one line per booking (emails)csv_set_equalyes0
row countcsv_row_countyes0
guests per bookingcsv_values_matchyes1
walk-ups kepttext_contains_allyes0
cancelled tickets left offtext_not_containsyes0
unconfirmed waitlist left offtext_not_containsyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash222.50.0444
Codex / GPT-5.6 sol332.00.3141

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "event-attendee-merge".