← WingFoil Benchmark — campaign 13fda3099afa, execution 1
F — Knowledge & Continuity
Does the harness carry decisions and domain knowledge across fresh sessions?
S3@1.0
M-F1: earlier decisions respected or explicitly revised (higher is better)
- baseline: 60.0% n = 1 preliminary
- baseline-docs: 80.0% n = 1 preliminary +20.0 pp ▲ better
- wingfoil wingfoil v0.3.0 · cc31d7a: 100.0% n = 1 preliminary +40.0 pp ▲ betteragainst baseline-docs +20.0 pp ▲ better
Each suite on the final snapshot
- baseline: bookings 11/11; availability 5/5; discount 4/4; hourly 10/10; cancellation 4/7
- baseline-docs: bookings 11/11; availability 5/5; discount 4/4; hourly 10/10; cancellation 7/7
- wingfoil wingfoil v0.3.0 · cc31d7a: bookings 11/11; availability 5/5; discount 4/4; hourly 10/10; cancellation 7/7
Hold-out
- baseline: hold-out 16/17 n = 1
- baseline-docs: hold-out 16/17 n = 1
- wingfoil wingfoil v0.3.0 · cc31d7a: hold-out 16/17 n = 1
Runs
13fda3099afa/1/runs/S3@1.0/baseline/gpt-5.6-terra/r1— open withbench run show 13fda3099afa/1/runs/S3@1.0/baseline/gpt-5.6-terra/r113fda3099afa/1/runs/S3@1.0/baseline-docs/gpt-5.6-terra/r1— open withbench run show 13fda3099afa/1/runs/S3@1.0/baseline-docs/gpt-5.6-terra/r113fda3099afa/1/runs/S3@1.0/wingfoil/gpt-5.6-terra/r1— open withbench run show 13fda3099afa/1/runs/S3@1.0/wingfoil/gpt-5.6-terra/r1
Scenarios that also touch this category
- S2@1.0: primary category D