关于「大规模重复检验:结果与争议」,《可证伪性与可重复性危机》给出的定量结论是什么?
结论:三个大型重复项目给出的同方向显著率分别为 36.1%(心理学,35/97)、61%(经济学,11/18)与 62%(《自然》《科学》社会科学实验,13/21),重复效应量约为原研究的一半到三分之二。重复率不能直接换算成假发现率:一个没有任何假发现、但研究的效应很小的领域,重复率也可能很低。吉尔伯特等人关于异质性、单次重复与方案偏离的批评,与开放科学协作组的回应,各有道理。用置信区间判断重复时,合理的基准远低于 95%。下一章讨论怎样从源头上解决这些问题。
数据口径:本书不是医疗、心理或投资建议。 书中以标注框区分已发表的证据、可运行的 Python 计算(14 段程序,全部核对)、原典与作者的假说。
对照数据表
下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库
| share real true d | published: share real | replications significant | effect ratio | |
| 1.00 | 0.50 | 1.00 | 70% | 0.72 |
| 1.00 | 0.20 | 1.00 | 22% | 0.32 |
| 0.50 | 0.50 | 0.95 | 67% | 0.69 |
| 0.50 | 0.30 | 0.90 | 37% | 0.43 |
| 0.30 | 0.50 | 0.90 | 64% | 0.66 |
| 0.00 | 0.00 | 0.00 | 3% | 0.00 |
| replication size tau | replication in original CI | original in replication CI | |
| 1.0 x | 0.0 | 83.4% | 83.4% |
| 1.0 x | 0.5 | 78.5% | 78.5% |
| 2.5 x | 0.0 | 90.2% | 70.5% |
| 2.5 x | 0.5 | 84.5% | 63.2% |
| 5.0 x | 0.0 | 92.6% | 57.6% |
| 5.0 x | 0.5 | 86.7% | 49.9% |
查看完整验算程序
# A replication project modelled: a share pi of studied effects is real (true d), the rest
# zero; originals (15-50 per group) are published only if p < .05 in the claimed
# direction; replications are sized for 92 % power at the ORIGINAL estimate (as planned in
# OSC 2015). Illustrative values. Part 2, no bias at all: chance that one study's 95 % CI
# captures the other's estimate (original SE = 1, replication k times larger; tau = SD of
# true effects between settings).
import math, random
from statistics import NormalDist
Z, Phi = NormalDist().inv_cdf, NormalDist().cdf
def project(rng, pi, d, n_orig=(15, 50), attempts=100000):
succ, orig_sum, rep_sum, k, real = 0, 0.0, 0.0, 0, 0
for _ in range(attempts):
true_d = d if rng.random() < pi else 0.0
n = rng.randint(*n_orig)
se = math.sqrt(2 / n)
est = rng.gauss(true_d, se)
if est / se <= 1.96:
continue # not significant: stays in the drawer
n_rep = math.ceil(2 * (Z(0.975) + Z(0.92)) ** 2 / est ** 2)
se_r = math.sqrt(2 / n_rep)
rep = rng.gauss(true_d, se_r)
k += 1; real += true_d > 0; succ += rep / se_r > 1.96
orig_sum += est; rep_sum += rep
return k, real / k, succ / k, rep_sum / orig_sum
if __name__ == "__main__":
rng = random.Random(2015)
print("share real true d | published: share real | replications significant"
" | effect ratio")
for pi, d in ((1.0, 0.5), (1.0, 0.2), (0.5, 0.5), (0.5, 0.3), (0.3, 0.5), (0.0, 0.0)):
k, real, succ, ratio = project(rng, pi, d)
print(f" {pi:4.2f} {d:4.2f} | {real:22.2f} | {succ:24.0%}"
f" | {ratio:12.2f}")
print("replication size tau | replication in original CI"
" | original in replication CI")
for k in (1, 2.5, 5):
for tau in (0.0, 0.5):
sd = math.sqrt(1 + 1 / k + 2 * tau ** 2)
a, b = 2 * Phi(1.96 / sd) - 1, 2 * Phi(1.96 / math.sqrt(k) / sd) - 1
print(f" {k:4.1f} x {tau:3.1f} | {a:26.1%} | {b:26.1%}")唯一数据源与引用
范雅福(Fan, Y.). (2026). 《科学方法论、可证伪性与可重复性危机的数理统计》第 5 章「大规模重复检验:结果与争议」(版本 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.23782104
DOI: 10.5281/zenodo.23782104 · 阅读本章所在专著 · 5DL-B-033 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026033,
author = {Fan, Yafu},
title = {Scientific Methodology, Falsifiability and the Mathematical Statistics of the Replication Crisis},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.23782104},
url = {https://doi.org/10.5281/zenodo.23782104}
}