关于「发表偏倚、抽屉问题与赢家诅咒」,《可证伪性与可重复性危机》给出的定量结论是什么?

结论:期刊主要发表显著结果,这一筛选从 1959 年至今几乎没有变化。失效安全数只回答「效应是否存在」,而且假设抽屉里的研究平均效应为零;在本章的模拟中,它显示「极其稳健」,而发表文献把效应夸大了 42%。漏斗图的埃格检验把握度有限,没有报警不等于没有偏倚。在低功效研究中,显著结果的效应量被系统性夸大:真实 \(d = 0.20\)、功效 20% 时,显著结果平均约为 0.45(夸大约 2.2 倍),方向弄反的概率约 0.5%。下一章看大规模重复检验的实际结果。

数据口径:本书不是医疗、心理或投资建议。 书中以标注框区分已发表的证据、可运行的 Python 计算(14 段程序,全部核对)、原典与作者的假说。

English version

对照数据表

下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库与结论吻合的打印值: 0.20, 0.45

true d = 0.2: 63 per group gives power 0.202 (SE of d = 0.178)
formula: Type S = 0.0051, exaggeration ratio = 2.24, mean significant |d| = 0.45
400,000 simulated: mean |d| if significant 0.448; wrong sign 0.0054; smallest significant 0.349
powerexaggerationType S(holds for any true effect D with standard error SE)
0.068.010.2013D / SE = 0.29
0.084.720.0850D / SE = 0.51
0.103.710.0450D / SE = 0.65
0.202.260.0053D / SE = 1.11
0.301.810.0011D / SE = 1.43
0.501.410.0001D / SE = 1.96
0.801.120.0000D / SE = 2.80
0.951.030.0000D / SE = 3.60

核心公式

\[N_{fs} = \frac{(\sum z)^2}{1.645^2} - k.\]
查看完整验算程序
# Type M and Type S errors (Gelman & Carlin 2014). SE of d is about sqrt(2 / n); only p <
# .05 is "published". Exaggeration = mean |estimate| if significant / true d; Type S =
# wrong-sign share.
import math, random
from statistics import NormalDist
N = NormalDist()

def retrodesign(D, s, alpha=0.05):
    z = N.inv_cdf(1 - alpha / 2)
    hi, lo = 1 - N.cdf(z - D / s), N.cdf(-z - D / s)
    power = hi + lo
    # E|est| over the significant region, from the truncated-normal means of the two tails
    m_hi = D + s * N.pdf(z - D / s) / hi
    m_lo = D - s * N.pdf(-z - D / s) / lo if lo > 0 else 0.0
    exag = (hi * m_hi - lo * m_lo) / power / D
    return power, lo / power, exag

if __name__ == "__main__":
    d = 0.20
    n = next(n for n in range(2, 1000) if retrodesign(d, math.sqrt(2 / n))[0] >= 0.20)
    s = math.sqrt(2 / n)
    pw, ts, ex = retrodesign(d, s)
    print(f"true d = {d}: {n} per group gives power {pw:.3f} (SE of d = {s:.3f})")
    print(f"  formula: Type S = {ts:.4f}, exaggeration ratio = {ex:.2f},"
          f" mean significant |d| = {ex * d:.2f}")
    rng = random.Random(641); est = [rng.gauss(d, s) for _ in range(400000)]
    sig = [e for e in est if abs(e) / s > 1.96]; pos = [e for e in sig if e > 0]
    mean_sig = sum(map(abs, sig)) / len(sig)
    print(f"  400,000 simulated: mean |d| if significant {mean_sig:.3f};"
          f" wrong sign {1 - len(pos) / len(sig):.4f};"
          f" smallest significant {min(pos):.3f}")
    print("power   exaggeration   Type S"
          "      (holds for any true effect D with standard error SE)")
    for target in (0.06, 0.08, 0.10, 0.20, 0.30, 0.50, 0.80, 0.95):
        lo, hi = 1e-6, 10.0                  # bisection on D / SE
        for _ in range(60):
            mid = (lo + hi) / 2
            lo, hi = (mid, hi) if retrodesign(mid, 1.0)[0] < target else (lo, mid)
        pw, ts, ex = retrodesign(hi, 1.0)
        print(f" {pw:.2f}   {ex:12.2f}   {ts:8.4f}      D / SE = {hi:.2f}")

唯一数据源与引用

范雅福(Fan, Y.). (2026). 《科学方法论、可证伪性与可重复性危机的数理统计》第 4 章「发表偏倚、抽屉问题与赢家诅咒」(版本 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.23782104

DOI: 10.5281/zenodo.23782104 · 阅读本章所在专著 · 5DL-B-033 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026033,
  author    = {Fan, Yafu},
  title     = {Scientific Methodology, Falsifiability and the Mathematical Statistics of the Replication Crisis},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.23782104},
  url       = {https://doi.org/10.5281/zenodo.23782104}
}

本书其他章节结论