Business Bench

Tasks · desk · Drafting

Write up the warehouse lighting proposal

proposal-from-notes · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Please write up the lighting retrofit proposal for Zephyr Bike Works from Marcus's site walk and the call notes, priced from our rate card. Save it as proposal.md.

Workspace

  • call_notes.txt
  • proposal_ironwood_2025.md
  • rate_card.xlsx
  • site_walk_notes_2026-09-03.txt

Expected deliverables

  • proposal.md

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
high bay linetext_sentence_matchesyes0
disposal linetext_sentence_matchesyes0
lift linetext_sentence_matchesyes0
other lines priced from the 2026 ratestext_numbers_presentyes0
totaltext_sentence_matchesyes0
optional sensors priced separatelytext_sentence_matchesyes0
pole lights droppedcustomyes1
no leftovers from the old proposaltext_not_containsyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash221.00.0130
Codex / GPT-5.6 sol331.10.1474

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "proposal-from-notes".