What does Regression to the Mean and the Cover Jinx conclude, in numbers, about “A Conditional Expectation with Slope Below One: Why Top Stores Slip the Next Year”?

Answer: Chapter 1 shows that with a year-to-year correlation of 0.5 a share of 0.8380 of top-decile stores score lower next year although nobody relaxed, and rebuilds Secrist's "triumph of mediocrity" with Hotelling's rebuttal.

Scope of the numbers: Marked boxes separate published evidence, runnable Python calculations (22 programs), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.5, 0.8380

top-decile threshold z = 1.2816
rhoE[X|top]E[Y|top]keptP(Y<X)P(stay top)
0.21.75500.35100.200.91400.1720
0.41.75500.70200.400.86670.2665
0.51.75500.87750.500.83800.3240
0.61.75501.05300.600.80490.3902
0.81.75501.40400.800.71880.5624
0.91.75501.57950.900.65570.6886
kept = E[Y|top] / E[X|top] = rho exactly; no effort term

Key formula

\[E[Y \mid X = x] = \rho\,x .\]
Show the full program
# Chapter 1. p11: What a top-decile store should expect next year.
# Model: standardised scores X (this year) and Y (next year) are
# bivariate normal with correlation rho, so E[Y | X = x] = rho * x.
# Nothing about effort changes between years. For stores in the top
# 10 % of X we compute, by exact formulas and numerical integration,
# the mean of X, the expected mean of Y, the share whose score falls,
# and the share that stays in the top 10 %. rho values are illustrative.
# 模型:双变量正态,E[Y|X]=rho*X;头部 10 % 门店来年的预期位置。
import math


def phi(z):
    return math.exp(-0.5 * z * z) / math.sqrt(2.0 * math.pi)


def cdf(z):
    return 0.5 * (1.0 + math.erf(z / math.sqrt(2.0)))


def quantile(p):
    lo, hi = -10.0, 10.0
    for _ in range(200):
        mid = 0.5 * (lo + hi)
        if cdf(mid) < p:
            lo = mid
        else:
            hi = mid
    return 0.5 * (lo + hi)


TOP = 0.10
C = quantile(1.0 - TOP)          # threshold of the top decile


def integrate(f, a, b, n=20000):
    h = (b - a) / n
    return h * math.fsum(f(a + (i + 0.5) * h) for i in range(n))


def table_row(rho):
    s = math.sqrt(1.0 - rho * rho)
    mean_x = phi(C) / TOP
    mean_y = rho * mean_x
    worse = integrate(lambda x: phi(x) * cdf(x * (1 - rho) / s),
                      C, 9.0) / TOP
    stay = integrate(lambda x: phi(x) * (1.0 - cdf((C - rho * x) / s)),
                     C, 9.0) / TOP
    return mean_x, mean_y, worse, stay


if __name__ == "__main__":
    print("top-decile threshold z = {:.4f}".format(C))
    print("  rho   E[X|top]  E[Y|top]  kept   P(Y<X)  P(stay top)")
    for rho in (0.2, 0.4, 0.5, 0.6, 0.8, 0.9):
        mx, my, w, st = table_row(rho)
        print("  {:.1f}   {:.4f}    {:.4f}    {:.2f}   {:.4f}  {:.4f}"
              .format(rho, mx, my, my / mx, w, st))
    print("kept = E[Y|top] / E[X|top] = rho exactly; no effort term")

Single source and citation

Fan, Y. (2026). Regression to the Mean and the Cover Jinx: Posterior Calibration of Fortune Reports and Serial Independence in the Tale of the Lost Horse (Version 1.0.0), Chapter 1: A Conditional Expectation with Slope Below One: Why Top Stores Slip the Next Year. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-202 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026202,
  author    = {Fan, Yafu},
  title     = {Regression to the Mean and the Cover Jinx: Posterior Calibration of Fortune Reports and Serial Independence in the Tale of the Lost Horse},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book