关于「大规模重复检验:结果与争议」,《可证伪性与可重复性危机》给出的定量结论是什么?

结论:三个大型重复项目给出的同方向显著率分别为 36.1%(心理学,35/97)、61%(经济学,11/18)与 62%(《自然》《科学》社会科学实验,13/21),重复效应量约为原研究的一半到三分之二。重复率不能直接换算成假发现率:一个没有任何假发现、但研究的效应很小的领域,重复率也可能很低。吉尔伯特等人关于异质性、单次重复与方案偏离的批评,与开放科学协作组的回应,各有道理。用置信区间判断重复时,合理的基准远低于 95%。下一章讨论怎样从源头上解决这些问题。

数据口径:本书不是医疗、心理或投资建议。 书中以标注框区分已发表的证据、可运行的 Python 计算(14 段程序,全部核对)、原典与作者的假说。

English version

对照数据表

下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库

share real true d | published: share real | replications significant | effect ratio
1.000.50 | 1.00 | 70% | 0.72
1.000.20 | 1.00 | 22% | 0.32
0.500.50 | 0.95 | 67% | 0.69
0.500.30 | 0.90 | 37% | 0.43
0.300.50 | 0.90 | 64% | 0.66
0.000.00 | 0.00 | 3% | 0.00
replication size tau | replication in original CI | original in replication CI
1.0 x0.0 | 83.4% | 83.4%
1.0 x0.5 | 78.5% | 78.5%
2.5 x0.0 | 90.2% | 70.5%
2.5 x0.5 | 84.5% | 63.2%
5.0 x0.0 | 92.6% | 57.6%
5.0 x0.5 | 86.7% | 49.9%
查看完整验算程序
# A replication project modelled: a share pi of studied effects is real (true d), the rest
# zero; originals (15-50 per group) are published only if p < .05 in the claimed
# direction; replications are sized for 92 % power at the ORIGINAL estimate (as planned in
# OSC 2015). Illustrative values. Part 2, no bias at all: chance that one study's 95 % CI
# captures the other's estimate (original SE = 1, replication k times larger; tau = SD of
# true effects between settings).
import math, random
from statistics import NormalDist
Z, Phi = NormalDist().inv_cdf, NormalDist().cdf

def project(rng, pi, d, n_orig=(15, 50), attempts=100000):
    succ, orig_sum, rep_sum, k, real = 0, 0.0, 0.0, 0, 0
    for _ in range(attempts):
        true_d = d if rng.random() < pi else 0.0
        n = rng.randint(*n_orig)
        se = math.sqrt(2 / n)
        est = rng.gauss(true_d, se)
        if est / se <= 1.96:
            continue                        # not significant: stays in the drawer
        n_rep = math.ceil(2 * (Z(0.975) + Z(0.92)) ** 2 / est ** 2)
        se_r = math.sqrt(2 / n_rep)
        rep = rng.gauss(true_d, se_r)
        k += 1; real += true_d > 0; succ += rep / se_r > 1.96
        orig_sum += est; rep_sum += rep
    return k, real / k, succ / k, rep_sum / orig_sum

if __name__ == "__main__":
    rng = random.Random(2015)
    print("share real  true d | published: share real | replications significant"
          " | effect ratio")
    for pi, d in ((1.0, 0.5), (1.0, 0.2), (0.5, 0.5), (0.5, 0.3), (0.3, 0.5), (0.0, 0.0)):
        k, real, succ, ratio = project(rng, pi, d)
        print(f"   {pi:4.2f}      {d:4.2f}  | {real:22.2f} | {succ:24.0%}"
              f" | {ratio:12.2f}")
    print("replication size  tau | replication in original CI"
          " | original in replication CI")
    for k in (1, 2.5, 5):
        for tau in (0.0, 0.5):
            sd = math.sqrt(1 + 1 / k + 2 * tau ** 2)
            a, b = 2 * Phi(1.96 / sd) - 1, 2 * Phi(1.96 / math.sqrt(k) / sd) - 1
            print(f"   {k:4.1f} x        {tau:3.1f} | {a:26.1%} | {b:26.1%}")

唯一数据源与引用

范雅福(Fan, Y.). (2026). 《科学方法论、可证伪性与可重复性危机的数理统计》第 5 章「大规模重复检验:结果与争议」(版本 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.23782104

DOI: 10.5281/zenodo.23782104 · 阅读本章所在专著 · 5DL-B-033 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026033,
  author    = {Fan, Yafu},
  title     = {Scientific Methodology, Falsifiability and the Mathematical Statistics of the Replication Crisis},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.23782104},
  url       = {https://doi.org/10.5281/zenodo.23782104}
}

本书其他章节结论