关于「发表偏倚、抽屉问题与赢家诅咒」,《可证伪性与可重复性危机》给出的定量结论是什么?
结论:期刊主要发表显著结果,这一筛选从 1959 年至今几乎没有变化。失效安全数只回答「效应是否存在」,而且假设抽屉里的研究平均效应为零;在本章的模拟中,它显示「极其稳健」,而发表文献把效应夸大了 42%。漏斗图的埃格检验把握度有限,没有报警不等于没有偏倚。在低功效研究中,显著结果的效应量被系统性夸大:真实 \(d = 0.20\)、功效 20% 时,显著结果平均约为 0.45(夸大约 2.2 倍),方向弄反的概率约 0.5%。下一章看大规模重复检验的实际结果。
数据口径:本书不是医疗、心理或投资建议。 书中以标注框区分已发表的证据、可运行的 Python 计算(14 段程序,全部核对)、原典与作者的假说。
对照数据表
下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库与结论吻合的打印值: 0.20, 0.45
| true d = 0.2: 63 per group gives power 0.202 (SE of d = 0.178) | |||
| formula: Type S = 0.0051, exaggeration ratio = 2.24, mean significant |d| = 0.45 | |||
| 400,000 simulated: mean |d| if significant 0.448; wrong sign 0.0054; smallest significant 0.349 | |||
| power | exaggeration | Type S | (holds for any true effect D with standard error SE) |
| 0.06 | 8.01 | 0.2013 | D / SE = 0.29 |
| 0.08 | 4.72 | 0.0850 | D / SE = 0.51 |
| 0.10 | 3.71 | 0.0450 | D / SE = 0.65 |
| 0.20 | 2.26 | 0.0053 | D / SE = 1.11 |
| 0.30 | 1.81 | 0.0011 | D / SE = 1.43 |
| 0.50 | 1.41 | 0.0001 | D / SE = 1.96 |
| 0.80 | 1.12 | 0.0000 | D / SE = 2.80 |
| 0.95 | 1.03 | 0.0000 | D / SE = 3.60 |
核心公式
\[N_{fs} = \frac{(\sum z)^2}{1.645^2} - k.\]
查看完整验算程序
# Type M and Type S errors (Gelman & Carlin 2014). SE of d is about sqrt(2 / n); only p <
# .05 is "published". Exaggeration = mean |estimate| if significant / true d; Type S =
# wrong-sign share.
import math, random
from statistics import NormalDist
N = NormalDist()
def retrodesign(D, s, alpha=0.05):
z = N.inv_cdf(1 - alpha / 2)
hi, lo = 1 - N.cdf(z - D / s), N.cdf(-z - D / s)
power = hi + lo
# E|est| over the significant region, from the truncated-normal means of the two tails
m_hi = D + s * N.pdf(z - D / s) / hi
m_lo = D - s * N.pdf(-z - D / s) / lo if lo > 0 else 0.0
exag = (hi * m_hi - lo * m_lo) / power / D
return power, lo / power, exag
if __name__ == "__main__":
d = 0.20
n = next(n for n in range(2, 1000) if retrodesign(d, math.sqrt(2 / n))[0] >= 0.20)
s = math.sqrt(2 / n)
pw, ts, ex = retrodesign(d, s)
print(f"true d = {d}: {n} per group gives power {pw:.3f} (SE of d = {s:.3f})")
print(f" formula: Type S = {ts:.4f}, exaggeration ratio = {ex:.2f},"
f" mean significant |d| = {ex * d:.2f}")
rng = random.Random(641); est = [rng.gauss(d, s) for _ in range(400000)]
sig = [e for e in est if abs(e) / s > 1.96]; pos = [e for e in sig if e > 0]
mean_sig = sum(map(abs, sig)) / len(sig)
print(f" 400,000 simulated: mean |d| if significant {mean_sig:.3f};"
f" wrong sign {1 - len(pos) / len(sig):.4f};"
f" smallest significant {min(pos):.3f}")
print("power exaggeration Type S"
" (holds for any true effect D with standard error SE)")
for target in (0.06, 0.08, 0.10, 0.20, 0.30, 0.50, 0.80, 0.95):
lo, hi = 1e-6, 10.0 # bisection on D / SE
for _ in range(60):
mid = (lo + hi) / 2
lo, hi = (mid, hi) if retrodesign(mid, 1.0)[0] < target else (lo, mid)
pw, ts, ex = retrodesign(hi, 1.0)
print(f" {pw:.2f} {ex:12.2f} {ts:8.4f} D / SE = {hi:.2f}")唯一数据源与引用
范雅福(Fan, Y.). (2026). 《科学方法论、可证伪性与可重复性危机的数理统计》第 4 章「发表偏倚、抽屉问题与赢家诅咒」(版本 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.23782104
DOI: 10.5281/zenodo.23782104 · 阅读本章所在专著 · 5DL-B-033 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026033,
author = {Fan, Yafu},
title = {Scientific Methodology, Falsifiability and the Mathematical Statistics of the Replication Crisis},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.23782104},
url = {https://doi.org/10.5281/zenodo.23782104}
}