ScaffoldBench

The architectures

Six ways to put structure around a model.

Each is the same Claude model with the same tools and the same task. Only the harness around the model changes: how many calls it makes, what each call is shown, and who gets to say no.

How to read a glyph

Every architecture is drawn the same way on every page of this site: each call is a shape, and a line runs from the call that hands work on to the call that receives it. A shape means one thing in all six.

Agent
AgentA model call that acts, with tools.
Worker
WorkerA smaller call in a parallel pool, or a state change.
Reasoner
ReasonerA call with no tools: it can only think and reply.
Decision
DecisionA verifier or selector: it chooses and may send work back.
Gate
GateEvery action passes through it before it runs.
Reviewer
ReviewerA read-only call standing beside a gate.

Provenance of the numbers on this page

run set
scaffold-or-scale-v1
models
Haiku 4.5, Sonnet 5.5, Opus 5.5
effort
high
repeats
2
fixtures
replay
runs
900 / 900
strategy cost
$354.44
judge cost
$9.19
wall clock
9h 48m
git
fce5807b2d

Cost excludes judge calls, which are tracked separately so a scoring model never flatters or penalises an architecture. Every figure on this site is read from results/ at build time.