关于「实践与预注册试验」,《可证伪性与可重复性危机》给出的定量结论是什么?
结论:四步核查表依次检查一个说法是否事先可证伪、是否经过多重比较与可选停止、样本是否小到效应必然被夸大、是否经过独立重复并披露了利益关系。用于三个虚构的说法时,它能清楚地区分案例报告、保健品广告与预注册试验。用于本系列自身时,它显示本系列的方案只在写法上符合预注册的要求(尚未在登记平台登记),而且没有数据、效应量假设缺乏先验依据、由 AI 起草、作者有商业利益、没有独立重复。预注册试验以 \(d'\) 为唯一主要结局,每组 176 名可分析、招募 208 名,判定规则写成代码,无论结果如何都发表。
数据口径:本书不是医疗、心理或投资建议。 书中以标注框区分已发表的证据、可运行的 Python 计算(14 段程序,全部核对)、原典与作者的假说。
对照数据表
下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库与结论吻合的打印值: 176, 208
| control arm: observed d' mean 0.96 (true 1.00), SD between people 0.72 | |
| true d' raised by 0.25 -> observed difference 0.23 (hits 0.67 | 0.71, false alarms 0.33 -> 0.29) |
| only more sceptical (c lowered by 0.4) -> d' difference -0.02 (hits 0.78, false alarms 0.46) | |
| people per arm, 90 % power, alpha 0.05 | observed-d' SESOI 0.20 | 0.25 | 0.30 | |
| SD of observed d' | 0.60 | 191 | 123 | 86 |
| SD of observed d' | 0.72 | 274 | 176 | 123 |
| SD of observed d' | 0.90 | 427 | 274 | 191 |
| chosen: SESOI 0.25 (observed d'), SD 0.72 | 176 analysable per arm |
| allowing 15 % exclusions (attention checks, incomplete sessions) -> recruit 208 per arm, 416 in all |
查看完整验算程序
# Sample size for the Chapter 8 trial. Primary outcome: discrimination d' when judging 24
# news reports (12 contain an exaggerated claim from a methodological flaw, 12 are
# accurate), with the log-linear correction (add 0.5 to each count, 1 to each total;
# Hautus 1995). ASSUMED, not taken from any study: true d' in the control arm ~ N(1.0,
# 0.5) between people, criterion c ~ N(0, 0.5).
import math, random
from statistics import NormalDist, mean, stdev
N = NormalDist()
def observed_dprime(rng, d, c, n=12):
h = sum(rng.random() < N.cdf(d / 2 - c) for _ in range(n))
f = sum(rng.random() < N.cdf(-d / 2 - c) for _ in range(n))
return N.inv_cdf((h + 0.5) / (n + 1)) - N.inv_cdf((f + 0.5) / (n + 1)), h / n, f / n
def arm(rng, shift_d=0.0, shift_c=0.0, people=20000):
out = [observed_dprime(rng, rng.gauss(1.0 + shift_d, 0.5), rng.gauss(shift_c, 0.5))
for _ in range(people)]
return [o[0] for o in out], mean(o[1] for o in out), mean(o[2] for o in out)
def per_arm(sd, delta, alpha=0.05, power=0.90):
z = N.inv_cdf(1 - alpha / 2) + N.inv_cdf(power)
return math.ceil(2 * z ** 2 * sd ** 2 / delta ** 2) + 1
if __name__ == "__main__":
rng = random.Random(1995)
b, hb, fb = arm(rng)
a, ha, fa = arm(rng, shift_d=0.25)
s, hs, fs = arm(rng, shift_c=-0.4)
sd = stdev(b)
print(f"control arm: observed d' mean {mean(b):.2f} (true 1.00),"
f" SD between people {sd:.2f}")
print(f"true d' raised by 0.25 -> observed difference {mean(a) - mean(b):.2f}"
f" (hits {hb:.2f} -> {ha:.2f}, false alarms {fb:.2f} -> {fa:.2f})")
print(f"only more sceptical (c lowered by 0.4) ->"
f" d' difference {mean(s) - mean(b):+.2f}"
f" (hits {hs:.2f}, false alarms {fs:.2f})")
print("people per arm, 90 % power, alpha 0.05 | observed-d' SESOI 0.20 | 0.25 | 0.30")
for v in (0.60, round(sd, 2), 0.90):
ns = " |".join(f"{per_arm(v, dl):5d}" for dl in (0.20, 0.25, 0.30))
print(f" SD of observed d' = {v:.2f} {'':16s}|" + ns)
n = per_arm(round(sd, 2), 0.25)
rec = math.ceil(n / 0.85)
print(f"chosen: SESOI 0.25 (observed d'), SD {sd:.2f} -> {n} analysable per arm")
print(f"allowing 15 % exclusions (attention checks, incomplete sessions)"
f" -> recruit {rec} per arm,"
f" {2 * rec} in all")唯一数据源与引用
范雅福(Fan, Y.). (2026). 《科学方法论、可证伪性与可重复性危机的数理统计》第 8 章「实践与预注册试验」(版本 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.23782104
DOI: 10.5281/zenodo.23782104 · 阅读本章所在专著 · 5DL-B-033 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026033,
author = {Fan, Yafu},
title = {Scientific Methodology, Falsifiability and the Mathematical Statistics of the Replication Crisis},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.23782104},
url = {https://doi.org/10.5281/zenodo.23782104}
}