What does Star Ratings, Self-Selection and Bayesian Ranking conclude, in numbers, about “Closing the Loop: Shop Sorting, the Timing of Review Requests and a Falsification Plan”?

Answer: Chapter 8 gives a shop procedure: one invitation to every buyer, the red line that inviting only satisfied buyers inflates the mean by +0.583, sorting by the posterior lower bound, the distilled Review Sorter, and pre-registered tests needing 53,211 visits per arm, with the conditions that would overturn the book. Marked boxes separate published evidence, runnable Python calculations (21 programs), classical sources and the author's hypotheses.

Scope of the numbers: Chapter 1 explains the J-shaped star distribution with two filters, a purchasing bias and an under-reporting bias; with illustrative parameters the purchasing bias lifts the mean by +0.532 stars. Marked boxes separate published evidence, runnable Python calculations (21 programs), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.583, 21

90-day honest mean 4.064; mean at delivery 4.330
dayreviewsmeanbiasfaults in
1288.24.309+0.2450.080
3266.14.271+0.2070.221
7226.74.212+0.1490.442
14171.44.147+0.0830.689
21129.54.110+0.0460.826
3090.44.085+0.0220.918
4549.64.070+0.0060.976
first day with |bias| < 0.05: 21
gated mean exceeds the 90-day target by +0.583
Show the full program
# Chapter 8. p81: when to ask every buyer for a review, and why not to gate.
# Per 1000 orders (illustrative): at delivery the star mix is BUY0; a unit
# develops a fault with prob 0.08, at a time exponential with mean 12
# days, after which that buyer's star is 1. One request goes to every
# buyer on day d; the reply rate is 0.30 exp(-d / 25). The 90-day mean
# is the honest target. "Gated" = asking only buyers who first said they
# were happy (4 or 5 stars), a practice this book treats as a red line.
import math

BUY0 = (0.02, 0.03, 0.10, 0.30, 0.55)
FAULT, TAU, R0, DECAY = 0.08, 12.0, 0.30, 25.0


def mix_on(day):
    f = FAULT * (1.0 - math.exp(-day / TAU))
    sh = [(1.0 - f) * b for b in BUY0]
    sh[0] += f
    return sh


def mean(sh):
    return math.fsum((k + 1) * s for k, s in enumerate(sh))


target = mean(mix_on(90))
print("90-day honest mean %.3f; mean at delivery %.3f"
      % (target, mean(BUY0)))
print("%5s %9s %8s %8s %10s" % ("day", "reviews", "mean", "bias",
                                "faults in"))
for d in (1, 3, 7, 14, 21, 30, 45):
    sh = mix_on(d)
    rate = R0 * math.exp(-d / DECAY)
    seen = 1.0 - math.exp(-d / TAU)
    print("%5d %9.1f %8.3f %+8.3f %10.3f" % (
        d, 1000 * rate, mean(sh), mean(sh) - target, seen))
loss = [(abs(mean(mix_on(d)) - target), d) for d in range(1, 61)]
print("first day with |bias| < 0.05: %d"
      % min(d for b, d in loss if b < 0.05))
print("gated mean exceeds the 90-day target by %+.3f"
      % (mean([0, 0, 0] + list(mix_on(90)[3:])) /
         math.fsum(mix_on(90)[3:]) - target))

Single source and citation

Fan, Y. (2026). J-Shaped Self-Selection in Star Ratings, Bayesian-Average Ranking and Rating Inflation from the Nine-Rank System to Online Marketplaces (Version 1.0.0), Chapter 8: Closing the Loop: Shop Sorting, the Timing of Review Requests and a Falsification Plan. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-212 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026212,
  author    = {Fan, Yafu},
  title     = {J-Shaped Self-Selection in Star Ratings, Bayesian-Average Ranking and Rating Inflation from the Nine-Rank System to Online Marketplaces},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book