Business Bench

Tasks · desk · Bookkeeping

Chargeback tracker with evidence deadlines

chargeback-tracker · timeout 1800 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Please bring our chargeback tracker up to date from the Ridgepay exports in the folder - June's note says what she wants and the dispute guide explains the rules. Save it as chargebacks.csv.

Workspace

  • holidays_2026.txt
  • note_from_june.txt
  • ridgepay_dispute_decisions_2026-09-11.csv
  • ridgepay_dispute_guide.md
  • ridgepay_dispute_notices_2026-06-01_to_2026-09-11.csv

Expected deliverables

  • chargebacks.csv

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
tracker columnscsv_columnsyes0
one row per casecsv_set_equalyes0
row countcsv_row_countyes0
evidence deadlinescustomyes0
statuscsv_values_matchyes2
disputed amountscsv_values_matchyes0
net losscsv_values_matchyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash331.20.0223
Codex / GPT-5.6 sol112.40.2309

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "chargeback-tracker".