Anti-Collapse Engineering with Two Anchors of Truth: the Variance-Collapse Rate of Self-Generated Training Data and Immunity through Standard-Library Recomputation and Textual Collation: chapter answers

When a model is retrained generation after generation on content it produced itself, the tails of the distribution disappear and its width collapses, which Shumailov and colleagues called model collapse in Nature in 2024. This book tests the founding claim that the variance collapses as sigma^2 (1-1/N)n and that mixing a fixed share of real sources into each generation prevents collapse, and corrects it after checking the originals: the formula is only the expectation under a maximum-likelihood refit, while the paper's theorem uses unbiased estimators, under which the expectation stays put an…

DOI pending · monograph page goes live after publication · 5DL-B-265 · 中文版

Illustrative model calculation, not a live quote