← WingFoil Benchmark — campaign 13fda3099afa, execution 1

Non-technical manager: A, B

Harness, not model: every arm runs the same agent with the same model, gpt-5.6-terra. Only the harness around it differs: baseline, baseline-docs, wingfoil.

Against the baseline, baseline-docs has no comparison: no metric of the category map was measured in both.

Against the baseline, wingfoil has no comparison: no metric of the category map was measured in both.

A and B are not covered in this campaign.

baseline baseline-docs wingfoil (wingfoil v0.3.0 · cc31d7a) 100% 50% 0%
M-Q1: the share of public hidden tests passed on the final snapshot, per arm, with the range of its runs and their n.
Categorybaselinebaseline-docswingfoil wingfoil v0.3.0 · cc31d7a
A — Inception & Specificationnot covered in this campaign
B — Planning & Managementnot covered in this campaign

Each value is the mean of its runs, with its n; a single run is preliminary, and so is a comparison unless both sides have n ≥ 3; a range is shown from n = 3. Deltas are against the baseline. How to read these results; which tools are eligible, and why.

Campaign 13fda3099afa, execution 1: 0 runs of gpt-5.6-terra.