Skip to content
Business BenchA benchmark for AI agents on business work

Tasks·desk·Spreadsheet

Material cost per product from the bill of materials

bom-cost-rollup·time budget 1200 s·source

The request

The task request supplied to the adapter, alongside the workspace below. Runtime instructions, authorized tools and skills also affect the system. Containerized runs withhold host-side references; local mode is not an isolation boundary.

Our accountant needs the material cost of each product we sell. Work it out from the BOM export and the price list and give me assembly_costs.xlsx, built so I can change a price later. Dale's email has the details.

Workspace

  • bom_export_2026-09-02.csv
  • email_from_dale.txt
  • price_list_2025.xlsx
  • price_list_2026-08.xlsx

Expected deliverables

  • assembly_costs.xlsx

Recorded acceptance checks

The table uses check names and outcomes from the frozen campaign ledger. Acceptance requires all required predicates to pass; a predicate may itself contain a tolerance or coverage threshold. Its scope is part of the measurement contract.

Recorded checkTypeRequiredFailed / observed
assembly_costs.xlsx existsfile_existsyes0 / 6
live formulasxlsx_has_formulasyes0 / 6
no error cellsxlsx_no_errorsyes2 / 6
IW-7230 72in workbench costxlsx_value_presentyes2 / 6
IW-4830 48in workbench costxlsx_value_presentyes2 / 6
IW-SR5 shelving rack costxlsx_value_presentyes2 / 6
IW-MC2 mobile cart costxlsx_value_presentyes2 / 6
IW-TS1 tool station costxlsx_value_presentyes2 / 6
Current task declaration (8 checks)

From task.yaml. Original runner grading and frozen retrospective scoring are separate. Read the frozen source for the rules behind the reported results.

  • assembly_costs.xlsx exists — file_exists, required
  • live formulas — xlsx_has_formulas, required
  • no error cells — xlsx_no_errors, required
  • IW-7230 72in workbench cost — xlsx_value_present, required
  • IW-4830 48in workbench cost — xlsx_value_present, required
  • IW-SR5 shelving rack cost — xlsx_value_present, required
  • IW-MC2 mobile cart cost — xlsx_value_present, required
  • IW-TS1 tool station cost — xlsx_value_present, required

Recorded results, desk release

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Original / 3Median minutesMean model estimate (USD)
Proto / DeepSeek V4.1 Flash334.00.0475
Codex / GPT-5.6 sol115.80.7432

These are repeated executions on the released fixture, not independent new business cases. Cost is captured model usage priced under the recorded assumptions, excluding infrastructure and human review. Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "bom-cost-rollup".

Recorded results, desk comparison, 28 September 2026

SystemRepetitionsFrozen / 3Original / 3Median minutes
Proto / GPT-6 sol332.1
Codex / GPT-6 sol332.9
Proto / DeepSeek V4.1 Flash331.7

A separate campaign under the same frozen scorer, not pooled with the release. Conditions and data.