Business Bench

Tasks · desk · Tooling

Fall menu page with allergens for the QR code

menu-page-allergens · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Can you make the fall menu page for the QR code on the tables? Everything's in the menu workbook, and Mei's note and Kenji's 86 list are in the folder. Save it as index.html.

Workspace

  • 86_list_from_chef.txt
  • menu_master_fall_2026.xlsx
  • note_from_mei.txt

Expected deliverables

  • index.html

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
index.html existsfile_existsyes0
every dish on the menutext_contains_allyes0
86'd dishes left offtext_not_containsyes0
new prices on the menutext_numbers_presentyes0
page structurecustomyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash332.20.0270
Codex / GPT-5.6 sol333.60.3967

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "menu-page-allergens".