Study 260725091 — reported

30 done · partially reproduced

View study →
STUDY 260725091ARM 008 / 30
← Study record

Selected arm evidence

Pythia 410M × CNN / DailyMail

Track R · seed 42 · R-pythia-410m-cnn_dailymail-s42

This arm tests the Pythia 410M and CNN / DailyMail configuration under Track R at seed 42. The release-protocol result agrees with the published direction.

Arm directional labelMATCHOne arm; not the study classification.
Study classificationpartially reproducedFrozen across all 30 selected arms.
01

Published and rerun estimates

Interval inclusion and directional agreement are reported separately

Published reward Δ-0.2586Reported comparison point
Release-protocol reward Δ-0.5445Selected sampled endpoint
Conditional 95% interval[-0.8633, -0.2379]Fixed checkpoint and retained generations

Conditional interval comparison

Reward-difference estimates and conditional 95% intervals

Both estimates use the same horizontal scale; whisker length represents interval width.

The circle and square mark the release-sampled and paired-deterministic estimates. Horizontal lines show their supplied conditional 95% intervals. The dashed vertical line marks the published reward difference, and the solid vertical line marks zero. These intervals do not estimate training-to-training variance.
Numerical interval inclusionPublished estimate inside interval

This reports only whether the published point estimate falls inside the supplied conditional release interval.

Directional assessmentAgrees with the published direction

The machine-readable arm record labels this result as agrees; this arm-level assessment does not replace the study verdict.

Independent paired endpoint

Independent deterministic paired comparison

The Holm-adjusted p-value is calculated for this paired endpoint within its track. It does not apply to the sampled release endpoint.

Paired reward Δ
-0.2052
Conditional 95% interval
[-0.4924, +0.0884]
Within-track Holm p
1.0000