关于「四十条无用规则里的两个假冠军」,《伪发现率与文案规则检验》给出的定量结论是什么?
结论:更值得看的是分布的形状。一条假冠军都没有的概率只有 0.1285,换句话说,一百个这样的星期里,大约只有十三个星期的冠军榜是干净的;至少一条的概率是 0.8715。恰好一条与恰好两条的概率分别是 0.2706 与 0.2777,最可能出现的条数就是两条。三条及以上的概率是 0.3233,五条及以上也还有 0.0480,接近二十个星期里有一个。
数据口径:书中转化率、访客数与规则条数均为示意参数;全部计算由书中程序生成;本书属于非个人化经营建议。 本书用精确概率推翻这条常识:四十条全部无效的规则同时检验,平均每周冒出两条假冠军,至少一条的概率为 0.8715;模拟中每周最佳假冠军宣称的相对提升平均为 34.2 %,而真实提升为零。
对照数据表
下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库与结论吻合的打印值: 0.0480, 0.1285, 0.2706, 0.2777, 0.3233, 0.8715
| m = 40 true nulls, alpha = 0.05 each | ||
| E[false champions] = 2.000 (exact 2) | ||
| k | P(V = k) | P(V >= k) |
| 0 | 0.1285 | 1.0000 |
| 1 | 0.2706 | 0.8715 |
| 2 | 0.2777 | 0.6009 |
| 3 | 0.1851 | 0.3233 |
| 4 | 0.0901 | 0.1381 |
| 5 | 0.0342 | 0.0480 |
| 6 | 0.0105 | 0.0139 |
| 7 | 0.0027 | 0.0034 |
| most likely count = 2 | ||
| P(no false champion) = 0.95^40 = 0.1285 | ||
| P(at least one) | = 0.8715 |
查看完整验算程序
# Chapter 1. p11: forty useless copy rules, each tested at p < 0.05.
# Model: m = 40 independent one-sided tests whose null hypotheses are
# all true; each p-value is uniform, so the number of "champions" V
# (p < alpha) is Binomial(40, 0.05). Exact arithmetic with Fraction.
# m and alpha are illustrative; the binomial law is exact.
import math
import operator
from fractions import Fraction
from functools import reduce
M = 40
ALPHA = Fraction(1, 20)
def pmf(k):
return math.comb(M, k) * ALPHA ** k * (1 - ALPHA) ** (M - k)
if __name__ == "__main__":
probs = [pmf(k) for k in range(M + 1)]
# exact Fraction totals via reduce (no float rounding)
mean = reduce(operator.add, (k * p for k, p in enumerate(probs)))
print("m = {} true nulls, alpha = {:.2f} each".format(M, float(ALPHA)))
print("E[false champions] = {:.3f} (exact {})".format(
float(mean), mean))
print(" k P(V = k) P(V >= k)")
for k in range(0, 8):
tail = reduce(operator.add, probs[k:])
print(" {:d} {:.4f} {:.4f}".format(
k, float(probs[k]), float(tail)))
mode = max(range(M + 1), key=lambda k: (probs[k], -k))
print("most likely count = {}".format(mode))
print("P(no false champion) = 0.95^40 = {:.4f}".format(
float(probs[0])))
print("P(at least one) = {:.4f}".format(float(1 - probs[0])))唯一数据源与引用
范雅福(Fan, Y.). (2026). 《多重比较与伪发现率控制、同时检验数十条文案规则的本杰明尼霍赫伯格阶梯母典》第 1 章「四十条无用规则里的两个假冠军」(版本 1.0.0). 5D Library. DOI 待发布
DOI 待发布 · 专著页正式发布后上线(本站暂无专著页) · 5DL-B-307 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026307,
author = {Fan, Yafu},
title = {Multiple Comparisons and False-Discovery-Rate Control: the Benjamini-Hochberg Step-Up for Testing Dozens of Copy Rules at Once},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}