What does Regression to the Mean and the Cover Jinx conclude, in numbers, about “A Conditional Expectation with Slope Below One: Why Top Stores Slip the Next Year”?
Answer: Chapter 1 shows that with a year-to-year correlation of 0.5 a share of 0.8380 of top-decile stores score lower next year although nobody relaxed, and rebuilds Secrist's "triumph of mediocrity" with Hotelling's rebuttal.
Scope of the numbers: Marked boxes separate published evidence, runnable Python calculations (22 programs), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.5, 0.8380
| top-decile threshold z = 1.2816 | |||||
| rho | E[X|top] | E[Y|top] | kept | P(Y<X) | P(stay top) |
| 0.2 | 1.7550 | 0.3510 | 0.20 | 0.9140 | 0.1720 |
| 0.4 | 1.7550 | 0.7020 | 0.40 | 0.8667 | 0.2665 |
| 0.5 | 1.7550 | 0.8775 | 0.50 | 0.8380 | 0.3240 |
| 0.6 | 1.7550 | 1.0530 | 0.60 | 0.8049 | 0.3902 |
| 0.8 | 1.7550 | 1.4040 | 0.80 | 0.7188 | 0.5624 |
| 0.9 | 1.7550 | 1.5795 | 0.90 | 0.6557 | 0.6886 |
| kept = E[Y|top] / E[X|top] = rho exactly; no effort term |
Key formula
Show the full program
# Chapter 1. p11: What a top-decile store should expect next year.
# Model: standardised scores X (this year) and Y (next year) are
# bivariate normal with correlation rho, so E[Y | X = x] = rho * x.
# Nothing about effort changes between years. For stores in the top
# 10 % of X we compute, by exact formulas and numerical integration,
# the mean of X, the expected mean of Y, the share whose score falls,
# and the share that stays in the top 10 %. rho values are illustrative.
# 模型:双变量正态,E[Y|X]=rho*X;头部 10 % 门店来年的预期位置。
import math
def phi(z):
return math.exp(-0.5 * z * z) / math.sqrt(2.0 * math.pi)
def cdf(z):
return 0.5 * (1.0 + math.erf(z / math.sqrt(2.0)))
def quantile(p):
lo, hi = -10.0, 10.0
for _ in range(200):
mid = 0.5 * (lo + hi)
if cdf(mid) < p:
lo = mid
else:
hi = mid
return 0.5 * (lo + hi)
TOP = 0.10
C = quantile(1.0 - TOP) # threshold of the top decile
def integrate(f, a, b, n=20000):
h = (b - a) / n
return h * math.fsum(f(a + (i + 0.5) * h) for i in range(n))
def table_row(rho):
s = math.sqrt(1.0 - rho * rho)
mean_x = phi(C) / TOP
mean_y = rho * mean_x
worse = integrate(lambda x: phi(x) * cdf(x * (1 - rho) / s),
C, 9.0) / TOP
stay = integrate(lambda x: phi(x) * (1.0 - cdf((C - rho * x) / s)),
C, 9.0) / TOP
return mean_x, mean_y, worse, stay
if __name__ == "__main__":
print("top-decile threshold z = {:.4f}".format(C))
print(" rho E[X|top] E[Y|top] kept P(Y<X) P(stay top)")
for rho in (0.2, 0.4, 0.5, 0.6, 0.8, 0.9):
mx, my, w, st = table_row(rho)
print(" {:.1f} {:.4f} {:.4f} {:.2f} {:.4f} {:.4f}"
.format(rho, mx, my, my / mx, w, st))
print("kept = E[Y|top] / E[X|top] = rho exactly; no effort term")Single source and citation
Fan, Y. (2026). Regression to the Mean and the Cover Jinx: Posterior Calibration of Fortune Reports and Serial Independence in the Tale of the Lost Horse (Version 1.0.0), Chapter 1: A Conditional Expectation with Slope Below One: Why Top Stores Slip the Next Year. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-202 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026202,
author = {Fan, Yafu},
title = {Regression to the Mean and the Cover Jinx: Posterior Calibration of Fortune Reports and Serial Independence in the Tale of the Lost Horse},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 2 · The Flight Instructor's Illusion: Why Criticism Looks More Effective than Praise
- Chapter 3 · Splitting Variance into Skill and Luck: Repeated Measures, Intraclass Correlation and Reliability
- Chapter 4 · Shrinkage Estimation: James and Stein, Efron and Morris's Eighteen Batters, and Shrinkage Ranking
- Chapter 5 · The Cover Jinx: Select at the Peak and You Will See a Fall
- Chapter 6 · Posterior Calibration of Fortune Reports: Buying at the Low Point, Barnum Statements and the Brier Score
- Chapter 7 · Sources East and West: the Huainanzi's Old Man Who Lost His Horse and Galton's 1886 "Regression towards Mediocrity"
- Chapter 8 · Closing the Loop: Annual Reviews by Shrinkage Ranking, Copy without Causal Overstatement, and a Pre-registered Plan