What does Copy and Checkout Arithmetic conclude, in numbers, about “The Winner's Curse, the Barnum Effect on Free Report Pages and a Pre-Registered Experiment”?
Answer: Chapter 8 gives the winner's curse (only 0.624 of significant winners are real), the Barnum effect on free report pages and a pre-registered experiment with a refund guardrail (about 30,000 visitors per arm). Marked boxes separate published evidence, runnable Python calculations (16 programs), classical sources and the author's hypotheses.
Scope of the numbers: Conversion rates, refund rates and costs not attributed to a source are illustrative; all data are generated by its programs; the book is not legal advice. Marked boxes separate published evidence, runnable Python calculations (16 programs), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.624
tests 4000; significant winners 210; truly positive 131 (0.624) a winner's observed lift exceeds its true lift by +12.4% on average
Show the full program
# Chapter 8. p14: How many "winning" copy tests are real?
# True relative lifts of copy variants are drawn from a prior: 70% have no
# effect, 30% have a lift ~ Normal(+5%, 3%). Each test has 13,914 visitors
# per arm at a 3% baseline (p08's size for 3.0% -> 3.6%). We count the
# share of significant winners that are real, and how much the observed
# lift of a winner overstates its true lift (the winner's curse).
import random
from math import sqrt
def run(tests=4000, n=13914, base=0.03, seed=77014):
rng = random.Random(seed)
wins = real = 0
over = []
se = sqrt(2 * base * (1 - base) / n)
for _ in range(tests):
lift = 0.0 if rng.random() < 0.7 else rng.gauss(0.05, 0.03)
diff = base * lift + rng.gauss(0, se)
if diff / se > 1.959964:
wins += 1
real += lift > 0
over.append(diff / base - lift)
return wins, real, sum(over) / len(over)
if __name__ == "__main__":
w, r, o = run()
print(" tests 4000; significant winners {}; truly positive {} ({:.3f})"
.format(w, r, r / w))
print(" a winner's observed lift exceeds its true lift by {:+.1%}"
" on average".format(o))Single source and citation
Fan, Y. (2026). Persuasive Copywriting Algebra, Loss-Framing Asymmetry and Checkout Micro-Architecture (Version 1.0.0), Chapter 8: The Winner's Curse, the Barnum Effect on Free Report Pages and a Pre-Registered Experiment. 5D Library. https://doi.org/10.5281/zenodo.24090205
DOI: 10.5281/zenodo.24090205 · Read the monograph · 5DL-B-077 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026077,
author = {Fan, Yafu},
title = {Persuasive Copywriting Algebra, Loss-Framing Asymmetry and Checkout Micro-Architecture},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.24090205},
url = {https://doi.org/10.5281/zenodo.24090205}
}Other chapter answers in this book
- Chapter 1 · The Prospect-Theory Arithmetic of Loss Frames
- Chapter 2 · Signalling Models of Price Endings and Numerical Precision
- Chapter 3 · The Friction Equations of Checkout Micro-Architecture
- Chapter 4 · Cognitive Fluency and the Statistical Limits of Testing
- Chapter 5 · The Full Ledger of a Fear Frame: Refunds, Chargebacks and Repeat Purchases
- Chapter 6 · The Ceiling of the Funnel and the Best Price
- Chapter 7 · Han Feizi, the Wenxin diaolong and the Rhetoric of Gain and Harm