What does Regression to the Mean and the Cover Jinx conclude, in numbers, about “The Flight Instructor's Illusion: Why Criticism Looks More Effective than Praise”?
Answer: Chapter 2 replays the flight instructor's season: with feedback that does nothing, the instructor still sees criticism outperform praise by 2.529 units, and only a randomised comparison corrects it.
Scope of the numbers: Marked boxes separate published evidence, runnable Python calculations (22 programs), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 2.529
| landing-to-landing correlation rho = 0.3289 | ||||
| feedback | n | mean change | share better | share worse |
| praise | 175 | -1.298 | 0.126 | 0.874 |
| criticism | 189 | +1.231 | 0.815 | 0.185 |
| silence | 586 | +0.006 | 0.488 | 0.512 |
| apparent advantage of criticism over praise: +2.529 | ||||
| true causal effect of either word: | +0.000 |
Show the full program
# Chapter 2. p21: The flight instructor's season, with feedback that does
# nothing. 50 cadets fly 20 landings each. A landing's score is the
# cadet's skill (sd 0.7) plus a fresh draw of noise (sd 1). The instructor
# praises any landing above +1 and criticises any below -1; by
# construction neither word changes the next landing. We record what the
# instructor sees on the next landing. Fixed seed; parameters illustrative.
# 教官的一个训练季:表扬与批评都没有任何因果作用。
import math
import random
rng = random.Random(1974)
CADETS, LANDINGS = 50, 20
SKILL_SD, NOISE_SD, CUT = 0.7, 1.0, 1.0
after = {"praise": [], "criticism": [], "silence": []}
for _ in range(CADETS):
s = rng.gauss(0.0, SKILL_SD)
prev = s + rng.gauss(0.0, NOISE_SD)
for _ in range(LANDINGS - 1):
nxt = s + rng.gauss(0.0, NOISE_SD)
if prev > CUT:
key = "praise"
elif prev < -CUT:
key = "criticism"
else:
key = "silence"
after[key].append(nxt - prev)
prev = nxt
def mean(xs):
return math.fsum(xs) / len(xs)
if __name__ == "__main__":
rho = SKILL_SD ** 2 / (SKILL_SD ** 2 + NOISE_SD ** 2)
print("landing-to-landing correlation rho = {:.4f}".format(rho))
print("feedback n mean change share better share worse")
for key in ("praise", "criticism", "silence"):
d = after[key]
up = len([v for v in d if v > 0])
print("{:<10} {:>4} {:>+9.3f} {:>8.3f} {:>8.3f}"
.format(key, len(d), mean(d), up / len(d),
1 - up / len(d)))
gap = mean(after["criticism"]) - mean(after["praise"])
print("apparent advantage of criticism over praise: {:+.3f}"
.format(gap))
print("true causal effect of either word: +0.000")Single source and citation
Fan, Y. (2026). Regression to the Mean and the Cover Jinx: Posterior Calibration of Fortune Reports and Serial Independence in the Tale of the Lost Horse (Version 1.0.0), Chapter 2: The Flight Instructor's Illusion: Why Criticism Looks More Effective than Praise. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-202 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026202,
author = {Fan, Yafu},
title = {Regression to the Mean and the Cover Jinx: Posterior Calibration of Fortune Reports and Serial Independence in the Tale of the Lost Horse},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · A Conditional Expectation with Slope Below One: Why Top Stores Slip the Next Year
- Chapter 3 · Splitting Variance into Skill and Luck: Repeated Measures, Intraclass Correlation and Reliability
- Chapter 4 · Shrinkage Estimation: James and Stein, Efron and Morris's Eighteen Batters, and Shrinkage Ranking
- Chapter 5 · The Cover Jinx: Select at the Peak and You Will See a Fall
- Chapter 6 · Posterior Calibration of Fortune Reports: Buying at the Low Point, Barnum Statements and the Brier Score
- Chapter 7 · Sources East and West: the Huainanzi's Old Man Who Lost His Horse and Galton's 1886 "Regression towards Mediocrity"
- Chapter 8 · Closing the Loop: Annual Reviews by Shrinkage Ranking, Copy without Causal Overstatement, and a Pre-registered Plan