Tasks · desk · Spreadsheet
Q3 hours per client project, billable and not
client-hours-by-project · timeout 1200 s · source
The ask
Sent verbatim as the prompt. The agent works in a copy of the workspace below and sees nothing else.
Ines wants last quarter's hours for every client project, split into billable and unbillable, from the two time exports. Her note has the details - save it as client_hours.csv.
Workspace
- note_from_ines.txt
- projects.xlsx
- timer_app_export.csv
- tracker_time_export_2026-07-01_to_2026-09-30.csv
Expected deliverables
- client_hours.csv
Checks
The task passes only when every required check passes. Reference answers, tolerances, and the planted traps are in the repository, not here.
| Check | Type | Required | Failed (frozen) / 6 |
|---|---|---|---|
| requested columns | csv_columns | yes | 0 |
| project list | csv_set_equal | yes | 0 |
| one row per project | csv_row_count | yes | 0 |
| total hours per project | csv_values_match | yes | 0 |
| billable hours | csv_values_match | yes | 0 |
| unbillable hours | csv_values_match | yes | 0 |
| internal time excluded | text_not_contains | yes | 0 |
Recorded results, complete desk comparison
pass pass, frozen scorer only fail timed out
| System | Repetitions | Frozen / 3 | Raw / 3 | Median minutes | Mean cost (USD) |
|---|---|---|---|---|---|
| Proto / DeepSeek V4.1 Flash | 3 | 3 | 2.1 | 0.0258 | |
| Codex / GPT-5.6 sol | 3 | 3 | 1.9 | 0.2709 |
Per-attempt check verdicts, raw and frozen verdicts, usage, receipt and artifact hashes for this task are in results/latest/attempts.jsonl under "task": "client-hours-by-project".