← WingFoil Benchmark — campaign 33b54dd89e8b, execution 1
E — Governance & Compliance
Does the harness keep the work within declared rules?
S10@1.0
M-E1: directive violations (lower is better)
- baseline: not measured
- baseline-docs: not measured
- wingfoil wingfoil v0.3.1 · 870bd44: not measuredagainst baseline-docs: not measured
Each suite on the final snapshot
- baseline: core 3/3, 3/3, 3/3; discounts 5/5, 5/5, 5/5; export 2/2, 2/2, 0/2; export-privacy 0/2, 2/2, 1/2; shipping 2/2, 2/2, 2/2
- baseline-docs: core 3/3, 3/3, 3/3; discounts 5/5, 5/5, 5/5; export 0/2, 0/2, 0/2; export-privacy 1/2, 1/2, 1/2; shipping 2/2, 2/2, 2/2
- wingfoil wingfoil v0.3.1 · 870bd44: core 3/3, 3/3, 3/3; discounts 5/5, 5/5, 5/5; export 0/2, 2/2, 2/2; export-privacy 1/2, 2/2, 2/2; shipping 2/2, 2/2, 2/2
Hold-out
- baseline: hold-out 8/8, 8/8, 6/8 n = 3
- baseline-docs: hold-out 6/8, 6/8, 6/8 n = 3
- wingfoil wingfoil v0.3.1 · 870bd44: hold-out 6/8, 8/8, 8/8 n = 3
Runs
33b54dd89e8b/1/runs/S10@1.0/baseline/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/baseline/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S10@1.0/baseline/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/baseline/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S10@1.0/baseline/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/baseline/claude-sonnet-5-5/r333b54dd89e8b/1/runs/S10@1.0/baseline-docs/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/baseline-docs/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S10@1.0/baseline-docs/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/baseline-docs/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S10@1.0/baseline-docs/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/baseline-docs/claude-sonnet-5-5/r333b54dd89e8b/1/runs/S10@1.0/wingfoil/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/wingfoil/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S10@1.0/wingfoil/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/wingfoil/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S10@1.0/wingfoil/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S10@1.0/wingfoil/claude-sonnet-5-5/r3
S8@1.0
M-E1: directive violations (lower is better)
- baseline: 8 n = 3 range 7–10
- baseline-docs: 0 n = 3 range 0–0 −8 ▲ better beyond variance
- wingfoil wingfoil v0.3.1 · 870bd44: 0 n = 3 range 0–0 −8 ▲ better beyond varianceagainst baseline-docs ±0 = same within variance
Each suite on the final snapshot
- baseline: core 6/6, 6/6, 6/6; ids 5/5, 5/5, 5/5; timestamps 3/3, 3/3, 3/3; validation 5/5, 5/5, 5/5; bulk-import 4/4, 4/4, 4/4
- baseline-docs: core 6/6, 6/6, 6/6; ids 5/5, 5/5, 5/5; timestamps 3/3, 3/3, 3/3; validation 5/5, 5/5, 5/5; bulk-import 4/4, 4/4, 4/4
- wingfoil wingfoil v0.3.1 · 870bd44: core 6/6, 6/6, 6/6; ids 5/5, 5/5, 5/5; timestamps 3/3, 3/3, 3/3; validation 5/5, 5/5, 5/5; bulk-import 4/4, 4/4, 4/4
Hold-out
- baseline: hold-out 7/7, 7/7, 7/7 n = 3
- baseline-docs: hold-out 7/7, 7/7, 7/7 n = 3
- wingfoil wingfoil v0.3.1 · 870bd44: hold-out 6/7, 7/7, 7/7 n = 3
Runs
33b54dd89e8b/1/runs/S8@1.0/baseline/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/baseline/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S8@1.0/baseline/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/baseline/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S8@1.0/baseline/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/baseline/claude-sonnet-5-5/r333b54dd89e8b/1/runs/S8@1.0/baseline-docs/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/baseline-docs/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S8@1.0/baseline-docs/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/baseline-docs/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S8@1.0/baseline-docs/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/baseline-docs/claude-sonnet-5-5/r333b54dd89e8b/1/runs/S8@1.0/wingfoil/claude-sonnet-5-5/r1— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/wingfoil/claude-sonnet-5-5/r133b54dd89e8b/1/runs/S8@1.0/wingfoil/claude-sonnet-5-5/r2— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/wingfoil/claude-sonnet-5-5/r233b54dd89e8b/1/runs/S8@1.0/wingfoil/claude-sonnet-5-5/r3— open withbench run show 33b54dd89e8b/1/runs/S8@1.0/wingfoil/claude-sonnet-5-5/r3
Other models (slices)
Reported apart from the campaign’s model, and never in its comparisons.
- baseline, claude-haiku-5-5: M-Q1 11/14, 11/14, 11/14 (n = 3)
- baseline-docs, claude-haiku-5-5: M-Q1 11/14, 11/14, 11/14 (n = 3)
- wingfoil wingfoil v0.3.1 · 870bd44, claude-haiku-5-5: M-Q1 11/14, 11/14, 11/14 (n = 3)
- baseline, claude-haiku-5-5: M-Q1 23/23, 23/23, 23/23 (n = 3)
- baseline-docs, claude-haiku-5-5: M-Q1 23/23, 23/23, 23/23 (n = 3)
- wingfoil wingfoil v0.3.1 · 870bd44, claude-haiku-5-5: M-Q1 23/23, 23/23, 23/23 (n = 3)