Withhold tax against a schedule only a service holds
Measured at 25% over 4 counted trials, which is inside the band gate 5 admits. The breakdown below says which model that figure came from.
- 25%
- measured pass rate
- 1 of 4 counted trials met the reward threshold.
- 1
- model measured
- Each cell is one agent against one model, run for the same number of attempts.
- 1
- errored trials
- Trials that produced no reward. Counted separately and never in the rate above.
- 5
- trials dispatched
- Every attempt this round started, including the ones that errored before a reward.
What each model did
One row per agent-and-model cell of the round that produced the figure above. The bar is passes over counted trials.
The table scrolls sideways.
| Agent | Model | Passed | Rate | Errored |
|---|---|---|---|---|
| Codex CLI | GPT-5.3 Codexopenai | 1 of 4 | 25% | 1 |
A cell with no passes is not a broken task: it is the point of one. Gate 5 admits a task only when the full matrix lands between 10 and 60 percent, so a set that every model cleared would have been rejected for being too easy before it reached this page.
The task
Compute the tax to be deducted at source on a company's vendor payments. The rate schedule is not in the repository at all: an MCP server is the only authority for rates, thresholds and the amendments that moved them, so every figure has to be fetched rather than assumed.
- Category
- Finance and taxation
- Declared tier
- medium. The tier is the author's declaration and it decides which band passes: a hard-tier task may legitimately sit under 10 percent, where a standard one may not.
- Languages
- python
- Catalogue reference
- tds-rate-service. The name a licensed copy carries, so a run of it is traceable back to this row.
- What a licence includes
- The graded task, its environment and verifier images pinned by digest, and the trial record behind the figures on this page.
- What stays with us
- The instruction, the test suite and the reference solution. Publishing those would retire the task, because a measurement you can read the answer to is not a measurement.