What does The Explanatory-Depth Razor conclude, in numbers, about “Field Tools and Checker Specifications: the False-Knowledge Register, the Four-Step Razor Scorer and a Pre-Registered Test”?

Answer: Chapter 8 sets out field tools and checker specifications: the false-knowledge register, the distilled Four-Step Razor and Pre-Decision Assumption-List Scorer, checkers grouped by kit, and a pre-registered test with its conditions for refutation; testing the drop in self-rating needs 88 raters, and testing a small Brier improvement needs 1,047 people per group. Marked boxes separate published evidence, runnable Python calculations (22 programs), classical sources and the author's hypotheses.

Scope of the numbers: Parameters are illustrative, all data are synthetic, and every calculation is generated by the book's programs. Chapter 1 measures, in synthetic data, a drop of 1.283 points in self-rated understanding of devices against an interval for facts from -0.263 to 0.063 that includes zero.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 1047, 88

H1 raters for a 0.30 drop88
H2 raters for a 0.30 domain gap88
H3 forecasts per person m, persons per group, total forecasts
m20 sd 0.0490 n/group 1,047 total 41,880
m40 sd 0.0374 n/group 611 total 48,880
m80 sd 0.0300 n/group 393 total 62,880
m160 sd 0.0255 n/group 284 total 90,880
H4 resolved forecasts per bin97
Show the full program
# Chapter 8. p82: sample sizes for the pre-registered tests.
# H1 (rating drop, mechanism claims): paired, d_z = 0.30, two-sided
#     alpha 0.05, power 0.80: n = ((z_a + z_b) / d_z)^2.
# H2 (domain gap): drop on mechanism claims exceeds drop on fact claims
#     by 0.30 rating-sd, within person: same formula.
# H3 (Brier gain from razor + reasons-against): two groups of decision
#     makers, each scored on m resolved forecasts; person-level sd of the
#     mean Brier = sqrt(tau^2 + sigma^2 / m) with sigma = 0.20 per
#     forecast, tau = 0.02 between persons; smallest gain worth acting
#     on = 0.006 (about the delta 0.4 row of p51).
# H4 (reliability table): forecasts per bin so the observed frequency is
#     known to +-0.10 at 95%: n = 1.96^2 * 0.25 / 0.10^2.
import math
from statistics import NormalDist

Z = NormalDist()
ZA, ZB = Z.inv_cdf(0.975), Z.inv_cdf(0.80)
K = (ZA + ZB) ** 2
print("H1 raters for a 0.30 drop: {}".format(math.ceil(K / 0.30 ** 2)))
print("H2 raters for a 0.30 domain gap: {}".format(math.ceil(K / 0.09)))
print("H3 forecasts per person m, persons per group, total forecasts")
for m in (20, 40, 80, 160):
    sd = math.sqrt(0.02 ** 2 + 0.20 ** 2 / m)
    n = math.ceil(2.0 * K * sd ** 2 / 0.006 ** 2)
    print("   m = {:3d}   sd {:.4f}   n/group {:5,}   total {:7,}".format(
        m, sd, n, 2 * n * m))
print("H4 resolved forecasts per bin: {}".format(
    math.ceil(ZA ** 2 * 0.25 / 0.10 ** 2)))

Single source and citation

Fan, Y. (2026). Shattering the Illusion of Explanatory Depth, Epistemic Calibration and the Razor Separating True Knowledge from Assumed Familiarity (Version 1.0.0), Chapter 8: Field Tools and Checker Specifications: the False-Knowledge Register, the Four-Step Razor Scorer and a Pre-Registered Test. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-396 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026396,
  author    = {Fan, Yafu},
  title     = {Shattering the Illusion of Explanatory Depth, Epistemic Calibration and the Razor Separating True Knowledge from Assumed Familiarity},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book