RunSonnet 5.5repeat 1
Orchestrator-workers on HTTP 301 vs 308
claude-sonnet-5-5__orchestrator-workers__research-http-redirects__r1
Score
1.000
- Cost
- $0.558
- + $0.109 judging
- Latency
- 1m 17s
- setup 0.0s, grading 4.4s
- Turns
- 40
- Tool calls
- 34
- Subagents
- 3
- Tokens in / out
- 244k / 22k
- 156,038 read from cache
Did the design run?
- Run completed: heldharness.run-completedThe environment was built, the architecture returned and grading finished, none of them throwing.
- No API failures: heldharness.apiNo model call failed at the API.
- Every call ended: heldharness.calls-endedEvery call ended with a result, or was stopped by the run's own limits.
- No harness tool denied: heldharness.harness-toolsThe sandbox guard never denied a harness tool, nor a tool the session itself offered.
- Tool servers connected: heldharness.mcp-connectedEvery tool server the harness gave a call was connected when the session started.
- No foreign tool servers: heldharness.mcp-hermeticNo call loaded a tool server the harness did not give it.
- Builtin tools: heldharness.builtin-toolsA check recorded with the run.
- Structured replies arrived: heldharness.structured-outputEvery call that asked for structured output and ran to the end got it.
- No silent fallbacks: heldharness.not-degradedNo phase fell back on a default (an empty plan, a default winner) instead of its output.
- Judge answered: heldharness.judgeAt least one grading call returned a usable verdict.
- The task was decomposed: heldorchestrator-workers.decompositionThe orchestrator’s reply was read through its schema and held at least one subtask.
- The fan-out happened: heldorchestrator-workers.fan-outEvery subtask got a worker, every worker ran, and the recorded subagent count matches.
- The synthesis wrote the answer: heldorchestrator-workers.synthesisThe final answer came from the synthesis call, not from a worker’s report standing in for it.
- Each call was shown the right tools: heldorchestrator-workers.toolsThe orchestrator and the synthesis were shown no tools and every worker the task’s full toolset.
Phases
Drawn from the phase records: timing and cost per call, no tool calls or messages.
| Phase | Duration | Cost | Turns | Tools | Model |
|---|---|---|---|---|---|
| Decompose | 9.3s | $0.017 | 2 | 0 | claude-sonnet-5-5 |
| Worker 1: 301-spec | 35.8s | $0.165 | 17 | 16 | claude-sonnet-5-5 |
| Worker 2: 308-spec | 33.7s | $0.104 | 8 | 7 | claude-sonnet-5-5 |
| Worker 3: 301-vs-308-compare | 37.6s | $0.153 | 12 | 11 | claude-sonnet-5-5 |
| Synthesize | 30.4s | $0.120 | 1 | 0 | claude-sonnet-5-5 |
The call-by-call replay is not published for this run. Traces are large, so the repository keeps 9 of this run set’s 900 and leaves the rest out; the score, phases and final answer on this page come from the committed run record.
Runs you can replay
- A gate that blocked the right moveGated-execute · Haiku 4.5
- Three proposals beat one agentPropose-select · Haiku 4.5
- A verifier that earned its keepPlan-execute-verify · Sonnet 5.5
- A revision that did not helpPlan-execute-verify · Haiku 4.5
- The control, missing a stepSingle · Haiku 4.5
Record this cell yourself: npm run bench -- run --strategies orchestrator-workers --tasks research-http-redirects --models claude-sonnet-5-5 --repeats 1
Score breakdown
- passStates that 301 is "Moved Permanently" and 308 is "Permanent Redirect", and that both indicate the target resource has been assigned a new permanent URI.1.00weight 0.17
met, backed by verified evidence E1, E2. “The 301 (Moved Permanently) status code indicates that the target resource has been assigned a new permanent URI”
- passStates that a client following a 308 must not change the request method: a POST is repeated as a POST, with its body.1.00weight 0.25
met, backed by verified evidence E9, E7. “The request method and the body will not be modified by the client in the redirected request.”
- passStates that when following a 301 a user agent MAY change the request method from POST to GET (for historical reasons), which is the behaviour 308 exists to rule out.1.00weight 0.25
met, backed by verified evidence E4, E6. “For historical reasons, a user agent MAY change the request method from POST to GET for the subsequent request.”
- passStates that both 301 and 308 responses are heuristically cacheable, i.e. a cache may reuse them by default unless the method definition or explicit cache controls say otherwise.1.00weight 0.17
met, backed by verified evidence E11, E12, E13. “A 301 response is heuristically cacheable; i.e., unless otherwise indicated by the method definition or explicit cache controls”
- passStates that both codes are currently specified in RFC 9110 (HTTP Semantics), and that 308 was originally defined in RFC 7538, which RFC 9110 obsoletes.1.00weight 0.17
met, backed by verified evidence E17, E18. “both are in RFC 9110 (HTTP Semantics), 301 in §15.4.2 and 308 in §15.4.9.”
Penalties
No penalties were applied.
Scorer metadata
- corpus
- {"version":2,"snapshot":"2026-10-01","hash":"25fbed79c4f7f9e1b850436e0e4872f8e25dd80142f3177231c456f21817b817","documents":8}
- opened documents
- ["rfc9110","rfc7538","mdn-status-301","mdn-status-308","rfc9111","rfc7231"]
- opened by role
- {"primary":["rfc9110"],"superseded":["rfc7538","rfc7231"],"secondary":["mdn-status-301","mdn-status-308","rfc9111"]}
- displayed share
- {"rfc9110":0.0673,"rfc7538":0.782,"mdn-status-301":1,"mdn-status-308":1,"rfc9111":0.1065,"rfc7231":0.06,"mdn-status-307":0.1091}
- cited count
- 6
- verified count
- 6
- hallucinated count
- 0
- citation integrity
- 1
- hallucinated urls
- []
- evidence block
- true
- evidence block repaired
- false
- evidence count
- 21
- verified quote count
- 21
- verified quote rate
- 1
- evidence
- [{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"RFC 9110 defines 301 as a permanent reassignment of the target resource to a new URI that future references should use","quote":"The 301 (Moved Permanently) status code indicates that the target resource has been assigned a new permanent URI and any future references to this resource ought to use one of the enclosed URIs.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"RFC 9110 defines 308 in the same permanent-move terms","quote":"The 308 (Permanent Redirect) status code indicates that the target resource has been assigned a new permanent URI and any future references to this resource ought to use one of the enclosed URIs.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"The user agent may follow the Location header automatically","quote":"The user agent MAY use the Location field value for automatic redirection.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"For a 301, a client may change POST to GET; 308 is the alternative if that is undesired","quote":"For historical reasons, a user agent MAY change the request method from POST to GET for the subsequent request. If this behavior is undesired, the 308 (Permanent Redirect) status code can be used instead.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"Historically clients were split and practice converged on changing the method to GET","quote":"Prevailing practice eventually converged on changing the method to GET.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"307 and 308 were added to unambiguously indicate method-preserving redirects while 301 and 302 were adjusted to allow POST to GET","quote":"307 (Temporary Redirect) and 308 (Permanent Redirect) [RFC7538] were later added to unambiguously indicate method-preserving redirects, and status codes 301 and 302 have been adjusted to allow a POST request to be redirected as GET.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc7538.html","claim":"308 is like 301 except that it does not allow changing POST to GET","quote":"This status code is similar to 301 (Moved Permanently) ([RFC7231], Section 6.4.2), except that it does not allow changing the request method from POST to GET.","verified":true,"document":"rfc7538"},{"url":"https://www.rfc-editor.org/rfc/rfc7538.html","claim":"308 was created to supply the missing permanent counterpart of 307","quote":"Section 6.4.7 of [RFC7231] states that it does not define a permanent variant of status code 307; this specification adds the status code 308, defining this missing variant (Section 3).","verified":true,"document":"rfc7538"},{"url":"https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/308","claim":"With 308 the client does not modify the method or body","quote":"The request method and the body will not be modified by the client in the redirected request.","verified":true,"document":"mdn-status-308"},{"url":"https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/301","claim":"Browsers following the Fetch Standard switch to GET after a 301 to a POST","quote":"In the Fetch Standard, when a user agent receives a 301 in response to a POST request, it uses the GET method in the subsequent redirection request, as permitted by the HTTP specification.","verified":true,"document":"mdn-status-301"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"RFC 9110 says 301 is heuristically cacheable (308 has the identical sentence)","quote":"A 301 response is heuristically cacheable; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [CACHING]).","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"RFC 9110 says 308 is heuristically cacheable","quote":"A 308 response is heuristically cacheable; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [CACHING]).","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"RFC 9110 lists both 301 and 308 among heuristically cacheable status codes","quote":"Responses with status codes that are defined as heuristically cacheable (e.g., 200, 203, 204, 206, 300, 301, 308, 404, 405, 410, 414, and 501 in this specification)","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc9111.html","claim":"The older term 'cacheable by default' was renamed 'heuristically cacheable'","quote":"Note that in previous specifications, heuristically cacheable response status codes were called \"cacheable by default\".","verified":true,"document":"rfc9111"},{"url":"https://www.rfc-editor.org/rfc/rfc7231.html","claim":"RFC 7231 originally specified 301 with 'cacheable by default' wording","quote":"A 301 response is cacheable by default; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [RFC7234]).","verified":true,"document":"rfc7231"},{"url":"https://www.rfc-editor.org/rfc/rfc7538.html","claim":"RFC 7538 originally specified 308 with 'cacheable by default' wording","quote":"A 308 response is cacheable by default; i.e., unless otherwise indicated by the method definition or explicit cache controls (see [RFC7234], Section 4.2.2).","verified":true,"document":"rfc7538"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"RFC 9110 is the current specification and obsoletes RFC 7231 (301) and RFC 7538 (308)","quote":"This document updates RFC 3864 and obsoletes RFCs 2818, 7231, 7232, 7233, 7235, 7538, 7615, 7694, and portions of 7230.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc7538.html","claim":"RFC 7538 originally defined 308 and obsoleted experimental RFC 7238 without technical changes","quote":"This specification contains no technical changes from the Experimental RFC 7238, which it obsoletes.","verified":true,"document":"rfc7538"},{"url":"https://www.rfc-editor.org/rfc/rfc9110.html","claim":"308 may not be recognized by older clients","quote":"This status code is much younger (June 2014) than its sibling codes and thus might not be recognized everywhere.","verified":true,"document":"rfc9110"},{"url":"https://www.rfc-editor.org/rfc/rfc7538.html","claim":"Because unknown 3xx codes are treated as 300, servers cannot rely on automatic redirection for 308 with old clients","quote":"Thus, servers will not be able to rely on automatic redirection happening similar to status codes 301, 302, or 307.","verified":true,"document":"rfc7538"},{"url":"https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/308","claim":"MDN's 308 page says 301 requires method preservation, which conflicts with RFC 9110's permission to change POST to GET","quote":"A 301 Moved Permanently requires the request method and the body to remain unchanged when redirection is performed, but this is incorrectly handled by older clients to use the GET method instead.","verified":true,"document":"mdn-status-308"}]
- judge unverified quotes
- 0
- judge verdicts
- [{"names":{"status":"met","support":["E1","E2"]},"method-preserved-308":{"status":"met","support":["E9","E7"]},"method-change-301":{"status":"met","support":["E4","E6"]},"cacheable":{"status":"met","support":["E11","E12","E13"]},"specifications":{"status":"met","support":["E17","E18"]}},{"names":{"status":"met","support":["E1","E2"]},"method-preserved-308":{"status":"met","support":["E9","E7"]},"method-change-301":{"status":"met","support":["E4","E6"]},"cacheable":{"status":"met","support":["E11","E12","E13"]},"specifications":{"status":"met","support":["E17","E18"]}},{"names":{"status":"met","support":["E1","E2"]},"method-preserved-308":{"status":"met","support":["E9","E7"]},"method-change-301":{"status":"met","support":["E4","E6"]},"cacheable":{"status":"met","support":["E11","E12","E13"]},"specifications":{"status":"met","support":["E17","E18"]}}]
- judge failures
- 0
- grounded weight share
- 1
Final answer
Short answer: 301 and 308 both mean "this resource has moved permanently." They differ in how a client must treat the request method. A client following a 301 may turn a POST into a GET, which drops the body. A client following a 308 must keep the method and body unchanged.
What each means. RFC 9110 defines both codes in nearly identical terms: the target resource has been assigned a new permanent URI, and future references ought to use it. For 301 the text is "The 301 (Moved Permanently) status code indicates that the target resource has been assigned a new permanent URI and any future references to this resource ought to use one of the enclosed URIs." (https://www.rfc-editor.org/rfc/rfc9110.html). The 308 text is the same with "308 (Permanent Redirect)". For both, the server should send a Location header, and "The user agent MAY use the Location field value for automatic redirection." (https://www.rfc-editor.org/rfc/rfc9110.html)
Method and body handling.
301: The method can change. RFC 9110 says: "For historical reasons, a user agent MAY change the request method from POST to GET for the subsequent request." It adds that if this is undesired, 308 can be used instead (https://www.rfc-editor.org/rfc/rfc9110.html).
- The history: HTTP/1.0 clients were split on whether to resend POST as POST. RFC 9110 says "Prevailing practice eventually converged on changing the method to GET." (https://www.rfc-editor.org/rfc/rfc9110.html)
- The workers reported that, per RFC 9110, a client that changes the method to GET or HEAD also removes content-specific headers such as Content-Type and Content-Length.
- Dropping the body on a POST→GET switch follows from GET carrying no body. That is an inference, not a quoted statement.
- Browsers follow the Fetch Standard. MDN says that on a 301 to a POST, "it uses the GET method in the subsequent redirection request, as permitted by the HTTP specification." (https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/301)
308: RFC 7538 describes it as "similar to 301 (Moved Permanently) ([RFC7231], Section 6.4.2), except that it does not allow changing the request method from POST to GET." (https://www.rfc-editor.org/rfc/rfc7538.html)
- MDN states the consequence directly: "The request method and the body will not be modified by the client in the redirected request." (https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/308)
- RFC 9110's own §15.4.9 text for 308 does not contain a "MUST NOT change the method" sentence. In RFC 9110 the rule is implied by the 301 note and by §15.4's remark that 307 and 308 "were later added to unambiguously indicate method-preserving redirects". The workers found that RFC 9110 states "MUST NOT" outright only for 307.
- Why 308 exists: 307 was the method-preserving temporary redirect, and there was no permanent equivalent. RFC 7538 says: "Section 6.4.7 of [RFC7231] states that it does not define a permanent variant of status code 307; this specification adds the status code 308, defining this missing variant (Section 3)." (https://www.rfc-editor.org/rfc/rfc7538.html) This gives the pairs 301↔308 (permanent) and 302↔307 (temporary), where the only difference within a pair is whether POST→GET rewriting is allowed.
Cacheability. Both are cacheable in the same way. RFC 9110 says: "A 301 response is heuristically cacheable; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [CACHING])." The 308 section uses the identical sentence (https://www.rfc-editor.org/rfc/rfc9110.html). RFC 9110 §15.1 lists both among the heuristically cacheable codes: "200, 203, 204, 206, 300, 301, 308, 404, 405, 410, 414, and 501". Explicit cache headers still apply. The older documents used different wording, "cacheable by default" (RFC 7231 for 301, https://www.rfc-editor.org/rfc/rfc7231.html; RFC 7538 for 308, https://www.rfc-editor.org/rfc/rfc7538.html). RFC 9111 notes that this is a rename, not a change: "Note that in previous specifications, heuristically cacheable response status codes were called \"cacheable by default\"." (https://www.rfc-editor.org/rfc/rfc9111.html)
Where each is specified.
- Current: both are in RFC 9110 (HTTP Semantics), 301 in §15.4.2 and 308 in §15.4.9. Its header says it "obsoletes RFCs 2818, 7231, 7232, 7233, 7235, 7538, 7615, 7694, and portions of 7230." (https://www.rfc-editor.org/rfc/rfc9110.html) Caching rules are in RFC 9111.
- Earlier: 301 was defined in RFC 7231 §6.4.2. RFC 7231 traces it to HTTP/1.0 (RFC 1945). 308 was defined in RFC 7538 (April 2015), which states it "contains no technical changes from the Experimental RFC 7238, which it obsoletes" (https://www.rfc-editor.org/rfc/rfc7538.html). RFC 7231 and RFC 7538 are both now obsoleted by RFC 9110.
- Unverified: the RFC 7538 page I was given shows only "Obsoletes: 7238", so its obsolete status rests on RFC 9110's header. No worker could open RFC 2616, so I make no claim about it.
Client support caveat. 308 is the newer code. RFC 9110 says it "is much younger (June 2014) than its sibling codes and thus might not be recognized everywhere." RFC 7538 §4 explains that unknown 3xx codes are treated like 300, so "servers will not be able to rely on automatic redirection". It restricts 308 to cases where the server trusts the client to understand it, or where falling back to 300 is harmless. The workers did not check browser-compatibility data, so I cannot give version-by-version support.
Source disagreement. MDN's 308 page says a 301 "requires the request method and the body to remain unchanged when redirection is performed, but this is incorrectly handled by older clients to use the GET method instead." That conflicts with RFC 9110, which explicitly permits POST→GET on a 301. MDN's own 301 page agrees with RFC 9110. I follow RFC 9110 as the authoritative specification and treat the MDN 308 wording as imprecise.
{"evidence": [
{"claim": "RFC 9110 defines 301 as a permanent reassignment of the target resource to a new URI that future references should use", "quote": "The 301 (Moved Permanently) status code indicates that the target resource has been assigned a new permanent URI and any future references to this resource ought to use one of the enclosed URIs.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "RFC 9110 defines 308 in the same permanent-move terms", "quote": "The 308 (Permanent Redirect) status code indicates that the target resource has been assigned a new permanent URI and any future references to this resource ought to use one of the enclosed URIs.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "The user agent may follow the Location header automatically", "quote": "The user agent MAY use the Location field value for automatic redirection.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "For a 301, a client may change POST to GET; 308 is the alternative if that is undesired", "quote": "For historical reasons, a user agent MAY change the request method from POST to GET for the subsequent request. If this behavior is undesired, the 308 (Permanent Redirect) status code can be used instead.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "Historically clients were split and practice converged on changing the method to GET", "quote": "Prevailing practice eventually converged on changing the method to GET.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "307 and 308 were added to unambiguously indicate method-preserving redirects while 301 and 302 were adjusted to allow POST to GET", "quote": "307 (Temporary Redirect) and 308 (Permanent Redirect) [RFC7538] were later added to unambiguously indicate method-preserving redirects, and status codes 301 and 302 have been adjusted to allow a POST request to be redirected as GET.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "308 is like 301 except that it does not allow changing POST to GET", "quote": "This status code is similar to 301 (Moved Permanently) ([RFC7231], Section 6.4.2), except that it does not allow changing the request method from POST to GET.", "url": "https://www.rfc-editor.org/rfc/rfc7538.html"},
{"claim": "308 was created to supply the missing permanent counterpart of 307", "quote": "Section 6.4.7 of [RFC7231] states that it does not define a permanent variant of status code 307; this specification adds the status code 308, defining this missing variant (Section 3).", "url": "https://www.rfc-editor.org/rfc/rfc7538.html"},
{"claim": "With 308 the client does not modify the method or body", "quote": "The request method and the body will not be modified by the client in the redirected request.", "url": "https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/308"},
{"claim": "Browsers following the Fetch Standard switch to GET after a 301 to a POST", "quote": "In the Fetch Standard, when a user agent receives a 301 in response to a POST request, it uses the GET method in the subsequent redirection request, as permitted by the HTTP specification.", "url": "https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/301"},
{"claim": "RFC 9110 says 301 is heuristically cacheable (308 has the identical sentence)", "quote": "A 301 response is heuristically cacheable; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [CACHING]).", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "RFC 9110 says 308 is heuristically cacheable", "quote": "A 308 response is heuristically cacheable; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [CACHING]).", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "RFC 9110 lists both 301 and 308 among heuristically cacheable status codes", "quote": "Responses with status codes that are defined as heuristically cacheable (e.g., 200, 203, 204, 206, 300, 301, 308, 404, 405, 410, 414, and 501 in this specification)", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "The older term 'cacheable by default' was renamed 'heuristically cacheable'", "quote": "Note that in previous specifications, heuristically cacheable response status codes were called \"cacheable by default\".", "url": "https://www.rfc-editor.org/rfc/rfc9111.html"},
{"claim": "RFC 7231 originally specified 301 with 'cacheable by default' wording", "quote": "A 301 response is cacheable by default; i.e., unless otherwise indicated by the method definition or explicit cache controls (see Section 4.2.2 of [RFC7234]).", "url": "https://www.rfc-editor.org/rfc/rfc7231.html"},
{"claim": "RFC 7538 originally specified 308 with 'cacheable by default' wording", "quote": "A 308 response is cacheable by default; i.e., unless otherwise indicated by the method definition or explicit cache controls (see [RFC7234], Section 4.2.2).", "url": "https://www.rfc-editor.org/rfc/rfc7538.html"},
{"claim": "RFC 9110 is the current specification and obsoletes RFC 7231 (301) and RFC 7538 (308)", "quote": "This document updates RFC 3864 and obsoletes RFCs 2818, 7231, 7232, 7233, 7235, 7538, 7615, 7694, and portions of 7230.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "RFC 7538 originally defined 308 and obsoleted experimental RFC 7238 without technical changes", "quote": "This specification contains no technical changes from the Experimental RFC 7238, which it obsoletes.", "url": "https://www.rfc-editor.org/rfc/rfc7538.html"},
{"claim": "308 may not be recognized by older clients", "quote": "This status code is much younger (June 2014) than its sibling codes and thus might not be recognized everywhere.", "url": "https://www.rfc-editor.org/rfc/rfc9110.html"},
{"claim": "Because unknown 3xx codes are treated as 300, servers cannot rely on automatic redirection for 308 with old clients", "quote": "Thus, servers will not be able to rely on automatic redirection happening similar to status codes 301, 302, or 307.", "url": "https://www.rfc-editor.org/rfc/rfc7538.html"},
{"claim": "MDN's 308 page says 301 requires method preservation, which conflicts with RFC 9110's permission to change POST to GET", "quote": "A 301 Moved Permanently requires the request method and the body to remain unchanged when redirection is performed, but this is incorrectly handled by older clients to use the GET method instead.", "url": "https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Status/308"}
]}Provenance of the numbers on this page
- run set
- scaffold-or-scale-v1
- models
- Haiku 4.5, Sonnet 5.5, Opus 5.5
- effort
- high
- repeats
- 2
- fixtures
- replay
- runs
- 900 / 900
- strategy cost
- $354.44
- judge cost
- $9.19
- wall clock
- 9h 48m
- git
- fce5807b2d
Cost excludes judge calls, which are tracked separately so a scoring model never flatters or penalises an architecture. Every figure on this site is read from results/ at build time.