What does Whitelist Licensing, Hooks and Scout Attribution conclude, in numbers, about “Dashboard Attribution Cannot Price a Licence”?
Answer: Start with panel A. With 1,000,000 people per group, the standard error of ROI is 0.354 and the confidence interval is 138.6 percentage points wide. Put differently, this experiment cannot tell a true ROI of zero from one that doubles the money. With 100,000 people per group the interval widens to 438.3 points; even with 10,000,000 per group it is still 43.8 points wide.
Scope of the numbers: Its parameters are illustrative, all calculations are generated by its programs, and it is general analysis, not business or legal advice. Chapter 6 prices the bypass option on a binomial tree, where a damages clause at the reasonable pre-estimate of 20.82 deters every bypass in the illustrative model.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.354, 100000, 1000000, 10000000, 138.6, 43.8
| A. ROI precision of a two-arm test (cv 10, illustrative) | ||
| n per arm | SE of ROI | 95% CI width, ROI points |
| 100,000 | 1.118 | 438.3 |
| 500,000 | 0.500 | 196.0 |
| 1,000,000 | 0.354 | 138.6 |
| 5,000,000 | 0.158 | 62.0 |
| 10,000,000 | 0.112 | 43.8 |
| B. n per arm to tell ROI gap d from zero (alpha 0.05, power 0.8) | ||
| d | n per arm | person-weeks, both arms |
| 0.25 | 15,697,760 | 31,395,520 |
| 0.50 | 3,924,440 | 7,848,880 |
| 1.00 | 981,110 | 1,962,220 |
| 2.00 | 245,278 | 490,556 |
| C. a campaign with true ROI 0.5 tested on 1,000,000 per arm | ||
| t statistic 1.41; chance its estimate shows a loss 0.0786 |
Show the full program
# Chapter 1. p11: why one campaign's ROI is so hard to read (Lewis-Rao).
# Model: per-person weekly sales have mean mu and standard deviation
# sigma = cv * mu; the ad costs c per exposed person; gross margin m.
# ROI = (m * delta - c) / c, delta = incremental sales per person.
# A two-arm test with n people per arm estimates delta with standard
# error sigma * sqrt(2 / n), so ROI has standard error
# (m / c) * sigma * sqrt(2 / n). cv = 10 is the order of magnitude
# Lewis and Rao (2015) call common; mu, c and m are illustrative.
import math
from statistics import NormalDist
MU, CV, COST, MARGIN = 7.0, 10.0, 0.14, 0.5
SIGMA = CV * MU
Z = NormalDist()
def roi_se(n):
return MARGIN / COST * SIGMA * math.sqrt(2.0 / n)
def n_per_arm(d_roi, alpha=0.05, power=0.80):
za = Z.inv_cdf(1 - alpha / 2)
zb = Z.inv_cdf(power)
delta = d_roi * COST / MARGIN
return math.ceil(2 * (za + zb) ** 2 * SIGMA ** 2 / delta ** 2)
if __name__ == "__main__":
z = Z.inv_cdf(0.975)
print("A. ROI precision of a two-arm test (cv 10, illustrative)")
print(" n per arm SE of ROI 95% CI width, ROI points")
for n in (100000, 500000, 1000000, 5000000, 10000000):
se = roi_se(n)
print(" {:>12,} {:>9.3f} {:>10.1f}".format(
n, se, 2 * z * se * 100))
print("B. n per arm to tell ROI gap d from zero (alpha 0.05, power 0.8)")
print(" d n per arm person-weeks, both arms")
for d in (0.25, 0.5, 1.0, 2.0):
n = n_per_arm(d)
print(" {:>5.2f} {:>12,} {:>14,}".format(d, n, 2 * n))
se = roi_se(1000000)
t = 0.5 / se
print("C. a campaign with true ROI 0.5 tested on 1,000,000 per arm")
print(" t statistic {:.2f}; chance its estimate shows a loss {:.4f}"
.format(t, Z.cdf(-t)))Single source and citation
Fan, Y. (2026). Dark-Ads Whitelist Licensing Economics, Three-Second Hook Survival Analysis and Single-Tier Scout Attribution Games (Version 1.0.0), Chapter 1: Dashboard Attribution Cannot Price a Licence. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-333 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026333,
author = {Fan, Yafu},
title = {Dark-Ads Whitelist Licensing Economics, Three-Second Hook Survival Analysis and Single-Tier Scout Attribution Games},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 2 · Pricing a Licence along the Wear-Out Curve
- Chapter 3 · The Three-Second Hook as a Survival Problem
- Chapter 4 · The Pixel Cold Start and Thompson Sampling
- Chapter 5 · Single-Tier Scout Commission by Shapley Value
- Chapter 6 · Liquidated Damages against Bypass Deals, and Statistical Power
- Chapter 7 · Buying the Box and Returning the Pearl, and Scientific Advertising
- Chapter 8 · The Monthly Review and a Pre-Registered Refutation