Selected arm evidence
SmolLM2 135M × TinyStories
Track M · seed 42 · M-smollm2-135m-tinystories-s42
This arm tests the SmolLM2 135M and TinyStories configuration under Track M at seed 42. The release-protocol result agrees with the published direction.
Published and rerun estimates
Interval inclusion and directional agreement are reported separately
Conditional interval comparison
Reward-difference estimates and conditional 95% intervals
Both estimates use the same horizontal scale; whisker length represents interval width.
+2.2563+1.9947This reports only whether the published point estimate falls inside the supplied conditional release interval.
The machine-readable arm record labels this result as agrees; this arm-level assessment does not replace the study verdict.
Independent paired endpoint
Independent deterministic paired comparison
The Holm-adjusted p-value is calculated for this paired endpoint within its track. It does not apply to the sampled release endpoint.
- Paired reward Δ
- +1.9947
- Conditional 95% interval
- [+1.6794, +2.3003]
- Within-track Holm p
- 0.0001
Selected execution
Selected execution status and recovery use
- Selected outcome
- Completed
- Recovery used
- No
- Claim-ready
- Yes
- Configuration
- SmolLM2 135M · TinyStories · seed 42
- Claim unit
- Track M · arm 025
Detailed attempt records are not yet public
The public release currently includes the selected arm result and study-level artifacts. It does not yet include attempt timelines, recovery lineage, selection reasons, raw outputs, or per-attempt artifact links. Those records require removal of infrastructure-specific data before publication.
Hardware and stack provenance
Observed hardware and software provenance
- GPU
- GeForce RTX 4090
- Neutral host alias
lab-workstation- Stack profile
- EXACT Paper-pinned training stack and claim evaluation.
- Protocol
- v1.0.0 with prospectively logged amendments · freeze
8a54ff56ab10d0795ae4e6845d61022b2916de97 - Evidence revision
b5dbeb008c98833091b040ffa61463bbc17504c7
This page excludes device UUIDs, private paths, raw hostnames, service identifiers, addresses, and credentials.
Study-level evidence
Study-level artifacts associated with this arm
The public release links this arm to the study bundle by its exact arm_id. It currently provides study-level artifacts but not per-attempt or raw-output links.
Interpretation limits
Arm-level uncertainty and interpretation constraints
- This arm contains one registered seed: 42.
- Every displayed interval is conditional on fixed checkpoints and retained generations; it is not training-to-training or decoding-to-decoding uncertainty.
MATCHis an arm-level directional label. The frozen study classification remains partially reproduced.- The public release does not yet include attempt timelines or direct raw-output links.