← WingFoil Benchmark — campaign 33b54dd89e8b, execution 1
F — Knowledge & Continuity
Does the harness carry decisions and domain knowledge across fresh sessions?
S3@1.0
M-F1: earlier decisions respected or explicitly revised (higher is better)
- baseline: 66.7% n = 3 range 60.0%–80.0%
- baseline-docs: 80.0% n = 3 range 80.0%–80.0% +13.3 pp ▲ better within variance
- wingfoil wingfoil v0.3.1 · 870bd44: 80.0% n = 3 range 80.0%–80.0% +13.3 pp ▲ better within varianceagainst baseline-docs ±0.0 pp = same within variance
Each suite on the final snapshot
- baseline: bookings 11/11, 11/11, 11/11; availability 5/5, 5/5, 5/5; discount 4/4, 4/4, 4/4; hourly 10/10, 10/10, 10/10; cancellation 5/7, 5/7, 7/7
- baseline-docs: bookings 11/11, 11/11, 11/11; availability 5/5, 5/5, 5/5; discount 4/4, 4/4, 4/4; hourly 10/10, 10/10, 10/10; cancellation 7/7, 7/7, 7/7
- wingfoil wingfoil v0.3.1 · 870bd44: bookings 11/11, 11/11, 11/11; availability 5/5, 5/5, 5/5; discount 4/4, 4/4, 4/4; hourly 10/10, 10/10, 10/10; cancellation 7/7, 7/7, 7/7
Hold-out
- baseline: hold-out 16/17, 16/17, 17/17 n = 3
- baseline-docs: hold-out 16/17, 17/17, 17/17 n = 3
- wingfoil wingfoil v0.3.1 · 870bd44: hold-out 16/17, 17/17, 16/17 n = 3
Runs
33b54dd89e8b/1/runs/S3@1.0/baseline/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/baseline/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S3@1.0/baseline/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/baseline/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S3@1.0/baseline/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/baseline/claude-sonnet-5-5/r333b54dd89e8b/1/runs/S3@1.0/baseline-docs/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/baseline-docs/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S3@1.0/baseline-docs/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/baseline-docs/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S3@1.0/baseline-docs/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/baseline-docs/claude-sonnet-5-5/r333b54dd89e8b/1/runs/S3@1.0/wingfoil/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/wingfoil/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S3@1.0/wingfoil/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/wingfoil/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S3@1.0/wingfoil/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S3@1.0/wingfoil/claude-sonnet-5-5/r3
Scenarios that also touch this category
- S2@1.0: primary category D
Other models (slices)
Reported apart from the campaign’s model, and never in its comparisons.
- baseline, claude-haiku-5-5: M-Q1 35/37, 34/37, 35/37 (n = 3)
- baseline-docs, claude-haiku-5-5: M-Q1 37/37, 35/37, 34/37 (n = 3)
- wingfoil wingfoil v0.3.1 · 870bd44, claude-haiku-5-5: M-Q1 37/37, 37/37, 37/37 (n = 3)