Business Bench

Tasks · desk · Spreadsheet

Normalize the catalog sizes for the new POS

catalog-normalize-units · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

We're moving the shop to the new POS. Turn the ShopKeep item export into a file the new system will import, using their template and field guide, and save it as catalog_clean.csv. Teodora's note has the changes.

Workspace

  • import_field_guide.txt
  • new_pos_import_template.csv
  • note_from_manager.txt
  • old_pos_items_export.xlsx

Expected deliverables

  • catalog_clean.csv

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
template columns in ordercsv_columnsyes0
every active itemcsv_set_equalyes0
pack quantitycsv_values_matchyes0
unit sizecsv_values_matchyes0
unitcsv_values_matchyes0
categorycsv_values_matchyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash302.10.0292
Codex / GPT-5.6 sol301.90.2394

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "catalog-normalize-units".