Rebuild a settlement ledger against withholding mints
Measured at 58% over 12 counted trials, which is inside the band gate 5 admits. The breakdown below says which model that figure came from.
- 58%
- measured pass rate
- 3
- models measured
- 0
- errored trials
- 12
- trials dispatched
7 of 12 counted trials met the reward threshold.
Each cell is one agent against one model, run for the same number of attempts.
Trials that produced no reward. Counted separately and never in the rate above.
Every attempt this round started, including the ones that errored before a reward.
What each model did
One row per agent-and-model cell of the round that produced the figure above. The bar is passes over counted trials.
The table scrolls sideways.
| Agent | Model | Passed | Rate | Errored |
|---|---|---|---|---|
| Terminus 2 | GPT-6 Astraopenai | 4 of 4 | 100% | none |
| Terminus 2 | Claude Fable 5.1anthropic | 3 of 4 | 75% | none |
| Codex CLI | GPT-5.3 Codexopenai | 0 of 4 | 0% | none |
A cell with no passes is not a broken task: it is the point of one. Gate 5 admits a task only when the full matrix lands between 10 and 60 percent, so a set that every model cleared would have been rejected for being too easy before it reached this page.
The task
A venue settles trades against quote pools, and the ledger has to be rebuilt from state so it can be reconciled against the chain. Some quote assets are tokens whose mints withhold part of every transfer and do not publish their terms, so the terms have to be inferred from the transfers that were made and what was kept out of them.
- Category
- Software engineering
- Declared tier
- medium. The tier is the author's declaration and it decides which band passes: a hard-tier task may legitimately sit under 10 percent, where a standard one may not.
- Languages
- python
- Harbor package
- prudo/curve-quote-settle. The name a licensed copy carries, so a run of it is traceable back to this row.
- What a licence includes
- The graded task, its environment and verifier images pinned by digest, and the trial record behind the figures on this page.
- What stays with us
- The instruction, the test suite and the reference solution. Publishing those would retire the task, because a measurement you can read the answer to is not a measurement.