What does Spiritual Quotient, Prior Conditioning and RAG Agents conclude, in numbers, about “Reliability, the "Shape" of a Profile and a Blind-Pick Test”?

Answer: Four items per dimension give an \(\alpha\) near 0.79; 0.90 needs 10. A profile's shape is less reliable than its scores: at a dimension correlation of 0.9 the difference of two dimensions has reliability 0.2776. Users' ratings of accuracy cannot show validity; a blind-pick test can, with a few hundred users at most.

Scope of the numbers: Marked boxes separate evidence, 16 runnable Python programs, classical sources and hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.2776, 0.79, 0.9, 0.90, 10

items per dimension: k2: 0.6577 k=4: 0.7935 k=8: 0.8849 k=10: 0.9057
k needed for alpha 0.805, for 0.90: 10
reliability of a difference of two scores (k4):
phi 0.00.7935
phi 0.30.7290
phi 0.60.6059
phi 0.90.2776
alpha from60 respondents: 5th 0.701, 95th 0.855
alpha from 300 respondents5th 0.764, 95th 0.823
Reading: four items give each dimension an alpha near 0.79;
0.90 needs ten. The shape of a profile is less reliable than
its parts, and much less when the dimensions correlate. A
pilot of 60 people cannot pin alpha down to better than about
a tenth.
Show the full program
# Chapter 2. p03: Reliability: alpha, Spearman-Brown and profile shape.
# Items load 0.7 on their dimension (p01), so two items of the same
# dimension correlate r = 0.49. For k items, Cronbach's alpha equals
# the Spearman-Brown value k r / (1 + (k - 1) r). The program gives
# alpha for k = 2, 4, 8, 10 and the k needed for 0.80 and 0.90. The
# reliability of a difference between two dimension scores (the
# "shape" of a profile) is (alpha - r12) / (1 - r12), where r12 is the
# correlation of the two observed scores, alpha phi. Finally, alpha is
# estimated from 400 simulated samples of 60 and of 300 respondents
# (4 items, phi = 0.3) to show its sampling spread (5th-95th centile).
import math
import random

R = 0.49

def sb(k, r=R):
    return k * r / (1 + (k - 1) * r)

def k_for(target, r=R):
    return math.ceil(target * (1 - r) / (r * (1 - target)))

def sample_alpha(rng, n, k=4, phi=0.3):
    rows = []
    for _ in range(n):
        g = rng.gauss(0, 1)
        f = math.sqrt(phi) * g + math.sqrt(1 - phi) * rng.gauss(0, 1)
        rows.append([0.7 * f + math.sqrt(1 - R) * rng.gauss(0, 1)
                     for _ in range(k)])
    def var(x):
        m = sum(x) / len(x)
        return sum((v - m) ** 2 for v in x) / (len(x) - 1)
    items = sum(var([r[j] for r in rows]) for j in range(k))
    total = var([sum(r) for r in rows])
    return k / (k - 1) * (1 - items / total)

if __name__ == "__main__":
    print("   items per dimension: " + "  ".join(
        "k={}: {:.4f}".format(k, sb(k)) for k in (2, 4, 8, 10)))
    print("   k needed for alpha 0.80: {}, for 0.90: {}".format(
        k_for(0.80), k_for(0.90)))
    a4 = sb(4)
    print("   reliability of a difference of two scores (k = 4):")
    for phi in (0.0, 0.3, 0.6, 0.9):
        r12 = a4 * phi
        print("     phi {:.1f}: {:.4f}".format(phi, (a4 - r12) / (1 - r12)))
    rng = random.Random(76003)
    for n in (60, 300):
        est = sorted(sample_alpha(rng, n) for _ in range(400))
        print("   alpha from {:3d} respondents: 5th {:.3f}, 95th {:.3f}"
              .format(n, est[20], est[379]))
    print("\nReading: four items give each dimension an alpha near 0.79;")
    print("0.90 needs ten. The shape of a profile is less reliable than")
    print("its parts, and much less when the dimensions correlate. A")
    print("pilot of 60 people cannot pin alpha down to better than about")
    print("a tenth.")

Single source and citation

Fan, Y. (2026). Spiritual Quotient Quantification, Prior-Conditioned Generation and Retrieval-Augmented Cognitive Agents (Version 1.0.0), Chapter 2: Reliability, the "Shape" of a Profile and a Blind-Pick Test. 5D Library. https://doi.org/10.5281/zenodo.24090203

DOI: 10.5281/zenodo.24090203 · Read the monograph · 5DL-B-076 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026076,
  author    = {Fan, Yafu},
  title     = {Spiritual Quotient Quantification, Prior-Conditioned Generation and Retrieval-Augmented Cognitive Agents},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.24090203},
  url       = {https://doi.org/10.5281/zenodo.24090203}
}

Other chapter answers in this book