Multiple Comparisons and False-Discovery-Rate Control: the Benjamini-Hochberg Step-Up for Testing Dozens of Copy Rules at Once: chapter answers

Owners often test dozens of copy rules at once, judge each at p below 0.05, and trust that the champions so chosen are broadly reliable. This book overturns that belief with exact probabilities: when forty rules that all do nothing are tested together, two false champions appear in an average week, and at least one appears with probability 0.8715; in simulation the best false champion of each week claims a relative lift of 34.2 % on average while its true lift is zero. The project blueprint attributed the claim to Benjamini and Hochberg's paper of 1995; after checking, the book corrects the b…

DOI pending · monograph page goes live after publication · 5DL-B-307 · 中文版

Illustrative model calculation, not a live quote