What does Star Ratings, Self-Selection and Bayesian Ranking conclude, in numbers, about “Closing the Loop: Shop Sorting, the Timing of Review Requests and a Falsification Plan”?
Answer: Chapter 8 gives a shop procedure: one invitation to every buyer, the red line that inviting only satisfied buyers inflates the mean by +0.583, sorting by the posterior lower bound, the distilled Review Sorter, and pre-registered tests needing 53,211 visits per arm, with the conditions that would overturn the book. Marked boxes separate published evidence, runnable Python calculations (21 programs), classical sources and the author's hypotheses.
Scope of the numbers: Chapter 1 explains the J-shaped star distribution with two filters, a purchasing bias and an under-reporting bias; with illustrative parameters the purchasing bias lifts the mean by +0.532 stars. Marked boxes separate published evidence, runnable Python calculations (21 programs), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.583, 21
| 90-day honest mean 4.064; mean at delivery 4.330 | ||||
| day | reviews | mean | bias | faults in |
| 1 | 288.2 | 4.309 | +0.245 | 0.080 |
| 3 | 266.1 | 4.271 | +0.207 | 0.221 |
| 7 | 226.7 | 4.212 | +0.149 | 0.442 |
| 14 | 171.4 | 4.147 | +0.083 | 0.689 |
| 21 | 129.5 | 4.110 | +0.046 | 0.826 |
| 30 | 90.4 | 4.085 | +0.022 | 0.918 |
| 45 | 49.6 | 4.070 | +0.006 | 0.976 |
| first day with |bias| < 0.05: 21 | ||||
| gated mean exceeds the 90-day target by +0.583 |
Show the full program
# Chapter 8. p81: when to ask every buyer for a review, and why not to gate.
# Per 1000 orders (illustrative): at delivery the star mix is BUY0; a unit
# develops a fault with prob 0.08, at a time exponential with mean 12
# days, after which that buyer's star is 1. One request goes to every
# buyer on day d; the reply rate is 0.30 exp(-d / 25). The 90-day mean
# is the honest target. "Gated" = asking only buyers who first said they
# were happy (4 or 5 stars), a practice this book treats as a red line.
import math
BUY0 = (0.02, 0.03, 0.10, 0.30, 0.55)
FAULT, TAU, R0, DECAY = 0.08, 12.0, 0.30, 25.0
def mix_on(day):
f = FAULT * (1.0 - math.exp(-day / TAU))
sh = [(1.0 - f) * b for b in BUY0]
sh[0] += f
return sh
def mean(sh):
return math.fsum((k + 1) * s for k, s in enumerate(sh))
target = mean(mix_on(90))
print("90-day honest mean %.3f; mean at delivery %.3f"
% (target, mean(BUY0)))
print("%5s %9s %8s %8s %10s" % ("day", "reviews", "mean", "bias",
"faults in"))
for d in (1, 3, 7, 14, 21, 30, 45):
sh = mix_on(d)
rate = R0 * math.exp(-d / DECAY)
seen = 1.0 - math.exp(-d / TAU)
print("%5d %9.1f %8.3f %+8.3f %10.3f" % (
d, 1000 * rate, mean(sh), mean(sh) - target, seen))
loss = [(abs(mean(mix_on(d)) - target), d) for d in range(1, 61)]
print("first day with |bias| < 0.05: %d"
% min(d for b, d in loss if b < 0.05))
print("gated mean exceeds the 90-day target by %+.3f"
% (mean([0, 0, 0] + list(mix_on(90)[3:])) /
math.fsum(mix_on(90)[3:]) - target))Single source and citation
Fan, Y. (2026). J-Shaped Self-Selection in Star Ratings, Bayesian-Average Ranking and Rating Inflation from the Nine-Rank System to Online Marketplaces (Version 1.0.0), Chapter 8: Closing the Loop: Shop Sorting, the Timing of Review Requests and a Falsification Plan. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-212 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026212,
author = {Fan, Yafu},
title = {J-Shaped Self-Selection in Star Ratings, Bayesian-Average Ranking and Rating Inflation from the Nine-Rank System to Online Marketplaces},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · Where the J Comes From: a U-Shaped Urge to Post and Two Self-Selection Biases
- Chapter 2 · Five Stars Do Not Sell Best: the Spiegel Curve at Source and a Small-Sample Reading
- Chapter 3 · The Wilson Lower Bound: Why Three Five-Star Reviews Rank Below Two Hundred at 4.6
- Chapter 4 · The Dirichlet-Prior Bayesian Average: Pseudo-Reviews Borrowed from the Shop
- Chapter 5 · Sorting Is Soliciting: the Shelf Feedback Loop, the Cost of Exploring and the First Five Reviews
- Chapter 6 · Rating Inflation: Norm Chasing, Information Decay and the Friction of Asking
- Chapter 7 · Classic Texts East and West: Liu Yi on the Nine-Rank System and Galton's "Vox Populi"