What does Spiritual Quotient, Prior Conditioning and RAG Agents conclude, in numbers, about “A Seven-Flag Audit and a Blind Comparison”?

Answer: Chapter 8 gives a seven-flag audit and a pre-registered blind comparison with a stranger's profile as control (1,047 users to detect a preference of 0.55). Marked boxes separate evidence, 16 runnable Python programs, classical sources and hypotheses.

Scope of the numbers: Marked boxes separate evidence, 16 runnable Python programs, classical sources and hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.55, 1047

(a) preference 0.55 users1,047
(a) preference 0.60 users259
(b) blind pick 0.5726 users495
(b) blind pick 0.7587 users35
(c) preference 0.55 with rating reliability 0.61,745
Reading: a modest real preference needs about a thousand
users; a strong one a few hundred. Swapping in a stranger's
profile, not removing the profile, is the right control:
it keeps everything the same except whose profile it is.
Show the full program
# Chapter 8. p16: Sample sizes for a pre-registered blind comparison.
# (a) Blind pairwise preference: each user puts one question and sees
#     two unlabeled answers, one from the profile-conditioned agent and
#     one from the same agent with a stranger's profile swapped in; the
#     user picks the better. Under no effect the pick rate is 0.5.
#     Users needed to detect 0.55 or 0.60 (two-sided 0.05, power 0.90).
# (b) Blind pick of reports (p04): the weakest case found there, a
#     hit rate of 0.5726, and the strongest, 0.7587.
# (c) Answer-level grading by two blind raters agreeing with kappa
#     0.6: the effective sample shrinks by the reliability of the
#     rating; n / 0.6 users are needed instead of n.
import math
from statistics import NormalDist

def n_needed(p, alpha=0.05, power=0.90):
    z = NormalDist().inv_cdf
    a = z(1 - alpha / 2) * 0.5
    b = z(power) * math.sqrt(p * (1 - p))
    return math.ceil(((a + b) / (p - 0.5)) ** 2)

if __name__ == "__main__":
    for label, p in (("(a) preference 0.55", 0.55),
                     ("(a) preference 0.60", 0.60),
                     ("(b) blind pick 0.5726", 0.5726),
                     ("(b) blind pick 0.7587", 0.7587)):
        print("   {:24s} users: {:,d}".format(label, n_needed(p)))
    print("   (c) preference 0.55 with rating reliability 0.6: {:,d}"
          .format(math.ceil(n_needed(0.55) / 0.6)))
    print("\nReading: a modest real preference needs about a thousand")
    print("users; a strong one a few hundred. Swapping in a stranger's")
    print("profile, not removing the profile, is the right control:")
    print("it keeps everything the same except whose profile it is.")

Single source and citation

Fan, Y. (2026). Spiritual Quotient Quantification, Prior-Conditioned Generation and Retrieval-Augmented Cognitive Agents (Version 1.0.0), Chapter 8: A Seven-Flag Audit and a Blind Comparison. 5D Library. https://doi.org/10.5281/zenodo.24090203

DOI: 10.5281/zenodo.24090203 · Read the monograph · 5DL-B-076 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026076,
  author    = {Fan, Yafu},
  title     = {Spiritual Quotient Quantification, Prior-Conditioned Generation and Retrieval-Augmented Cognitive Agents},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.24090203},
  url       = {https://doi.org/10.5281/zenodo.24090203}
}

Other chapter answers in this book