Business Bench

Tasks · desk · Extraction

Log this year's property tax bills

property-tax-bills · timeout 1800 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

This year's property tax bills are in the folder. Please log them in tax_bills.csv - Walt's note says what he needs to schedule the payments.

Workspace

  • note_from_walt.txt
  • parcels.csv
  • tax_bills_2026-27/Juniper_County_041-234-17.pdf
  • tax_bills_2026-27/Juniper_County_041-234-18.pdf
  • tax_bills_2026-27/KeelCounty_notice_DQ-26-4578.pdf
  • tax_bills_2026-27/KeelCounty_secured_tax_207005800.pdf
  • tax_bills_2026-27/KeelCounty_secured_tax_207015800.pdf
  • tax_bills_2026-27/scan_juniper_04123605.pdf

Expected deliverables

  • tax_bills.csv

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
requested columnscsv_columnsyes0
one row per parcelcsv_set_equalyes0
row countcsv_row_countyes0
county and delinquency flagcsv_values_matchyes0
assessed values and exemptionscsv_values_matchyes0
total taxcsv_values_matchyes0
installmentscsv_values_matchyes0
due datescsv_values_matchyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash332.60.0325
Codex / GPT-5.6 sol331.30.1841

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "property-tax-bills".