Comparison: campaign 81ebb2691f9c, execution 1 against campaign bf3a1ac7dff5, execution 1

Newer: campaign 81ebb2691f9c, execution 1, on claude-sonnet-5-5. Earlier: campaign bf3a1ac7dff5, execution 1, on claude-sonnet-5-5. Compared in the order the maintainer chose. Across campaigns only deltas against each execution's own baseline are compared.

Pins that differ

models.slices: none → claude-opus-5-5, claude-haiku-5-5
harnesses.openspec: none → openspec 1.14.0
harnesses.speckit: none → speckit v1.1.0
harnesses.wingfoil: wingfoil v0.2.2 → wingfoil v0.3.0
arm_digests.openspec: none → 1ba12def23cf
arm_digests.openspec-docs: none → 52d8775dd78c
arm_digests.speckit: none → 3f2ec815ac70
arm_digests.speckit-docs: none → b2fbe79ca773
arm_digests.wingfoil: 680b19f27c9f → 45a5cce3de19

Each arm against its own baseline

Category	Scenario	Arm	Model	Metric	campaign bf3a1ac7dff5, execution 1	campaign 81ebb2691f9c, execution 1	Change
C	S1@1.0	baseline-docs	claude-sonnet-5-5	M-Q1	−1.2 pp n = 3 / 3, range 95.8%–99.4% / 99.4%–99.4% within variance	−1.6 pp n = 3 / 3, range 95.8%–99.4% / 99.4%–100.0% within variance	−0.4 pp
C	S1@1.0	baseline-docs	claude-sonnet-5-5	M-K1	+0.0737 EUR n = 3 / 3, range 0.4034 EUR–0.4343 EUR / 0.3222 EUR–0.3878 EUR beyond variance	+0.1154 EUR n = 3 / 3, range 0.4388 EUR–0.4819 EUR / 0.3209 EUR–0.3703 EUR beyond variance	+0.0417 EUR
C	S1@1.0	wingfoil	claude-sonnet-5-5	M-Q1	−1.2 pp n = 3 / 3, range 95.8%–99.4% / 99.4%–99.4% within variance	−0.4 pp n = 3 / 3, range 99.4%–99.4% / 99.4%–100.0% within variance	+0.8 pp
C	S1@1.0	wingfoil	claude-sonnet-5-5	M-K1	+0.2516 EUR n = 3 / 3, range 0.5927 EUR–0.6152 EUR / 0.3222 EUR–0.3878 EUR beyond variance	+0.2402 EUR n = 3 / 3, range 0.5556 EUR–0.6013 EUR / 0.3209 EUR–0.3703 EUR beyond variance	−0.0113 EUR
D	S2@1.0	baseline-docs	claude-sonnet-5-5	M-Q1	±0.0 pp n = 1 / 1 preliminary	±0.0 pp n = 1 / 1 preliminary	±0.0 pp
D	S2@1.0	baseline-docs	claude-sonnet-5-5	M-D3	±0 n = 1 / 1 preliminary	±0 n = 1 / 1 preliminary	±0
D	S2@1.0	wingfoil	claude-sonnet-5-5	M-Q1	−12.5 pp n = 1 / 1 preliminary	±0.0 pp n = 1 / 1 preliminary	+12.5 pp
D	S2@1.0	wingfoil	claude-sonnet-5-5	M-D3	+3 n = 1 / 1 preliminary	±0 n = 1 / 1 preliminary	−3
E	S8@1.0	baseline-docs	claude-sonnet-5-5	M-E1	−22 n = 1 / 1 preliminary	−7 n = 1 / 1 preliminary	+15
E	S8@1.0	wingfoil	claude-sonnet-5-5	M-E1	−22 n = 1 / 1 preliminary	−7 n = 1 / 1 preliminary	+15
F	S3@1.0	baseline-docs	claude-sonnet-5-5	M-F1	+20.0 pp n = 1 / 1 preliminary	+20.0 pp n = 1 / 1 preliminary	±0.0 pp
F	S3@1.0	wingfoil	claude-sonnet-5-5	M-F1	+20.0 pp n = 1 / 1 preliminary	±0.0 pp n = 1 / 1 preliminary	−20.0 pp

Not compared

S1@1.0 baseline (claude-haiku-5-5): no slice of model claude-haiku-5-5 in bf3a1ac7dff5/1
S1@1.0 wingfoil (claude-haiku-5-5): no slice of model claude-haiku-5-5 in bf3a1ac7dff5/1
S3@1.0 baseline (claude-haiku-5-5): no slice of model claude-haiku-5-5 in bf3a1ac7dff5/1
S3@1.0 wingfoil (claude-haiku-5-5): no slice of model claude-haiku-5-5 in bf3a1ac7dff5/1
S1@1.0 baseline (claude-opus-5-5): no slice of model claude-opus-5-5 in bf3a1ac7dff5/1
S1@1.0 baseline-docs (claude-opus-5-5): no slice of model claude-opus-5-5 in bf3a1ac7dff5/1
S1@1.0 wingfoil (claude-opus-5-5): no slice of model claude-opus-5-5 in bf3a1ac7dff5/1

On one side only

S1@1.0 openspec (claude-sonnet-5-5): only in 81ebb2691f9c/1
S1@1.0 openspec-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S1@1.0 speckit (claude-sonnet-5-5): only in 81ebb2691f9c/1
S1@1.0 speckit-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S2@1.0 openspec (claude-sonnet-5-5): only in 81ebb2691f9c/1
S2@1.0 openspec-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S2@1.0 speckit (claude-sonnet-5-5): only in 81ebb2691f9c/1
S2@1.0 speckit-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S3@1.0 openspec (claude-sonnet-5-5): only in 81ebb2691f9c/1
S3@1.0 openspec-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S3@1.0 speckit (claude-sonnet-5-5): only in 81ebb2691f9c/1
S3@1.0 speckit-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S8@1.0 openspec (claude-sonnet-5-5): only in 81ebb2691f9c/1
S8@1.0 openspec-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1
S8@1.0 speckit (claude-sonnet-5-5): only in 81ebb2691f9c/1
S8@1.0 speckit-docs (claude-sonnet-5-5): only in 81ebb2691f9c/1