What does Spiritual Quotient, Prior Conditioning and RAG Agents conclude, in numbers, about “A Seven-Flag Audit and a Blind Comparison”?
Answer: Chapter 8 gives a seven-flag audit and a pre-registered blind comparison with a stranger's profile as control (1,047 users to detect a preference of 0.55). Marked boxes separate evidence, 16 runnable Python programs, classical sources and hypotheses.
Scope of the numbers: Marked boxes separate evidence, 16 runnable Python programs, classical sources and hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.55, 1047
| (a) preference 0.55 users | 1,047 |
| (a) preference 0.60 users | 259 |
| (b) blind pick 0.5726 users | 495 |
| (b) blind pick 0.7587 users | 35 |
| (c) preference 0.55 with rating reliability 0.6 | 1,745 |
| Reading: a modest real preference needs about a thousand | |
| users; a strong one a few hundred. Swapping in a stranger's | |
| profile, not removing the profile, is the right control: | |
| it keeps everything the same except whose profile it is. |
Show the full program
# Chapter 8. p16: Sample sizes for a pre-registered blind comparison.
# (a) Blind pairwise preference: each user puts one question and sees
# two unlabeled answers, one from the profile-conditioned agent and
# one from the same agent with a stranger's profile swapped in; the
# user picks the better. Under no effect the pick rate is 0.5.
# Users needed to detect 0.55 or 0.60 (two-sided 0.05, power 0.90).
# (b) Blind pick of reports (p04): the weakest case found there, a
# hit rate of 0.5726, and the strongest, 0.7587.
# (c) Answer-level grading by two blind raters agreeing with kappa
# 0.6: the effective sample shrinks by the reliability of the
# rating; n / 0.6 users are needed instead of n.
import math
from statistics import NormalDist
def n_needed(p, alpha=0.05, power=0.90):
z = NormalDist().inv_cdf
a = z(1 - alpha / 2) * 0.5
b = z(power) * math.sqrt(p * (1 - p))
return math.ceil(((a + b) / (p - 0.5)) ** 2)
if __name__ == "__main__":
for label, p in (("(a) preference 0.55", 0.55),
("(a) preference 0.60", 0.60),
("(b) blind pick 0.5726", 0.5726),
("(b) blind pick 0.7587", 0.7587)):
print(" {:24s} users: {:,d}".format(label, n_needed(p)))
print(" (c) preference 0.55 with rating reliability 0.6: {:,d}"
.format(math.ceil(n_needed(0.55) / 0.6)))
print("\nReading: a modest real preference needs about a thousand")
print("users; a strong one a few hundred. Swapping in a stranger's")
print("profile, not removing the profile, is the right control:")
print("it keeps everything the same except whose profile it is.")Single source and citation
Fan, Y. (2026). Spiritual Quotient Quantification, Prior-Conditioned Generation and Retrieval-Augmented Cognitive Agents (Version 1.0.0), Chapter 8: A Seven-Flag Audit and a Blind Comparison. 5D Library. https://doi.org/10.5281/zenodo.24090203
DOI: 10.5281/zenodo.24090203 · Read the monograph · 5DL-B-076 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026076,
author = {Fan, Yafu},
title = {Spiritual Quotient Quantification, Prior-Conditioned Generation and Retrieval-Augmented Cognitive Agents},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.24090203},
url = {https://doi.org/10.5281/zenodo.24090203}
}Other chapter answers in this book
- Chapter 1 · Five Dimensions or One: The Spectrum and Information of an SQ Scale
- Chapter 2 · Reliability, the "Shape" of a Profile and a Blind-Pick Test
- Chapter 3 · Prior Conditioning: How Much Uncertainty Can a Profile Remove?
- Chapter 4 · The Context Budget: Lagrangian Water-Filling and the Best Number of Passages
- Chapter 5 · Retrieval Augmentation: One-Book Recall and Cross-Book Synthesis
- Chapter 6 · The Library Graph: Islands, the Fiedler Value and a Small World
- Chapter 7 · Looking Up and Looking Down, and Shao Yong's Observing of Things