What does Molecules and Terroir conclude, in numbers, about “Practice: A Four-Step Check and a Pre-Registered Experiment”?

Answer: With 12 assessors the test misses most real but modest differences. With 36 it detects a difference that half the assessors can perceive almost every time. For routine checks of incoming goods, 24 assessors is a reasonable compromise; for a decision that matters, use more.

Scope of the numbers: The book is not medical advice and does not claim that any plant or extract treats or prevents any human disease. Marked boxes separate published evidence, runnable Python calculations (36, all checked), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 12, 24, 36

nneedpower if 30 % can tellpower if 50 % can tell
12826 %63 %
241355 %93 %
361872 %99 %
482288 %100 %
602792 %100 %
14/24 correct: one-sided p = 0.0103
Show the full program
from math import comb

def tail(n, x, p):
    """P(at least x correct out of n) when each is correct with probability p."""
    return sum(comb(n, k) * p ** k * (1 - p) ** (n - k) for k in range(x, n + 1))

def critical(n, alpha=0.05):
    """Fewest correct answers that show a difference (guessing rate 1/3)."""
    return next(x for x in range(n + 1) if tail(n, x, 1 / 3) <= alpha)

print(" n   need   power if 30 % can tell   power if 50 % can tell")
for n in (12, 24, 36, 48, 60):
    x = critical(n)
    powers = [tail(n, x, 1 / 3 + 2 / 3 * pd) for pd in (0.3, 0.5)]
    print(f"{n:2d}   {x:4d}   {100 * powers[0]:22.0f} %   {100 * powers[1]:22.0f} %")

# One panel's result (invented): 24 assessors, 14 picked the odd sample.
n, correct = 24, 14
print(f"{correct}/{n} correct: one-sided p = {tail(n, correct, 1 / 3):.4f}")

Single source and citation

Fan, Y. (2026). Molecules and Terroir (Version 1.0.0), Chapter 8: Practice: A Four-Step Check and a Pre-Registered Experiment. 5D Library. https://doi.org/10.5281/zenodo.23693057

DOI: 10.5281/zenodo.23693057 · Read the monograph · 5DL-B-007 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026007,
  author    = {Fan, Yafu},
  title     = {Molecules and Terroir},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.23693057},
  url       = {https://doi.org/10.5281/zenodo.23693057}
}

Other chapter answers in this book