Business Bench

Tasks · desk · Reformatting

Fall class schedule as a calendar file for the website

schedule-to-ics · timeout 1200 s · source

The ask

Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.

Can you turn our fall class schedule into a calendar file people can add from the website? Save it as schedule.ics. Jess's note says how she wants it.

Workspace

  • class_schedule_2026.xlsx
  • note_from_jess.txt
  • spring_2026_classes.ics

Expected deliverables

  • schedule.ics

This task also has a task-specific grader (check.py).

Checks

The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.

CheckTypeRequiredFailed (frozen) / 6
schedule.ics existsfile_existsyes0
every fall event and nothing elsecustomyes0
times carry the time zonecustomyes0
weekly series, occurrences and cancellationcustomyes0
all-day eventscustomyes0

Recorded results, complete desk comparison

pass pass, frozen scorer only fail timed out
SystemRepetitionsFrozen / 3Raw / 3Median minutesMean cost (USD)
Proto / DeepSeek V4.1 Flash331.30.0155
Codex / GPT-5.6 sol332.20.2472

Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "schedule-to-ics".