What does The Explanatory-Depth Razor conclude, in numbers, about “Field Tools and Checker Specifications: the False-Knowledge Register, the Four-Step Razor Scorer and a Pre-Registered Test”?
Answer: Chapter 8 sets out field tools and checker specifications: the false-knowledge register, the distilled Four-Step Razor and Pre-Decision Assumption-List Scorer, checkers grouped by kit, and a pre-registered test with its conditions for refutation; testing the drop in self-rating needs 88 raters, and testing a small Brier improvement needs 1,047 people per group. Marked boxes separate published evidence, runnable Python calculations (22 programs), classical sources and the author's hypotheses.
Scope of the numbers: Parameters are illustrative, all data are synthetic, and every calculation is generated by the book's programs. Chapter 1 measures, in synthetic data, a drop of 1.283 points in self-rated understanding of devices against an interval for facts from -0.263 to 0.063 that includes zero.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 1047, 88
| H1 raters for a 0.30 drop | 88 |
| H2 raters for a 0.30 domain gap | 88 |
| H3 forecasts per person m, persons per group, total forecasts | |
| m | 20 sd 0.0490 n/group 1,047 total 41,880 |
| m | 40 sd 0.0374 n/group 611 total 48,880 |
| m | 80 sd 0.0300 n/group 393 total 62,880 |
| m | 160 sd 0.0255 n/group 284 total 90,880 |
| H4 resolved forecasts per bin | 97 |
Show the full program
# Chapter 8. p82: sample sizes for the pre-registered tests.
# H1 (rating drop, mechanism claims): paired, d_z = 0.30, two-sided
# alpha 0.05, power 0.80: n = ((z_a + z_b) / d_z)^2.
# H2 (domain gap): drop on mechanism claims exceeds drop on fact claims
# by 0.30 rating-sd, within person: same formula.
# H3 (Brier gain from razor + reasons-against): two groups of decision
# makers, each scored on m resolved forecasts; person-level sd of the
# mean Brier = sqrt(tau^2 + sigma^2 / m) with sigma = 0.20 per
# forecast, tau = 0.02 between persons; smallest gain worth acting
# on = 0.006 (about the delta 0.4 row of p51).
# H4 (reliability table): forecasts per bin so the observed frequency is
# known to +-0.10 at 95%: n = 1.96^2 * 0.25 / 0.10^2.
import math
from statistics import NormalDist
Z = NormalDist()
ZA, ZB = Z.inv_cdf(0.975), Z.inv_cdf(0.80)
K = (ZA + ZB) ** 2
print("H1 raters for a 0.30 drop: {}".format(math.ceil(K / 0.30 ** 2)))
print("H2 raters for a 0.30 domain gap: {}".format(math.ceil(K / 0.09)))
print("H3 forecasts per person m, persons per group, total forecasts")
for m in (20, 40, 80, 160):
sd = math.sqrt(0.02 ** 2 + 0.20 ** 2 / m)
n = math.ceil(2.0 * K * sd ** 2 / 0.006 ** 2)
print(" m = {:3d} sd {:.4f} n/group {:5,} total {:7,}".format(
m, sd, n, 2 * n * m))
print("H4 resolved forecasts per bin: {}".format(
math.ceil(ZA ** 2 * 0.25 / 0.10 ** 2)))Single source and citation
Fan, Y. (2026). Shattering the Illusion of Explanatory Depth, Epistemic Calibration and the Razor Separating True Knowledge from Assumed Familiarity (Version 1.0.0), Chapter 8: Field Tools and Checker Specifications: the False-Knowledge Register, the Four-Step Razor Scorer and a Pre-Registered Test. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-396 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026396,
author = {Fan, Yafu},
title = {Shattering the Illusion of Explanatory Depth, Epistemic Calibration and the Razor Separating True Knowledge from Assumed Familiarity},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · The Boundary of the Illusion of Explanatory Depth: Strongest for Mechanisms, Weakest for Facts
- Chapter 2 · Calibration, Not Confidence: the Brier Score, Murphy's Decomposition and the Statistical Artefact in the Dunning-Kruger Chart
- Chapter 3 · The Four-Step Razor: Causal Chain, Order of Magnitude, Failure Boundary and Counterexample
- Chapter 4 · Scoring the Assumption List and the Value of Information: Which Assumption to Test First
- Chapter 5 · Reasons Against, the Premortem and Sealing the Ledger against Hindsight
- Chapter 6 · Turning "Fatal" and "Stripping" into Intervals: a Band of Decision Loss, a Small Effect and the Conditions for Refutation
- Chapter 7 · Reading the Classics: the Xunzi on Dispelling Obsession, Chapter Seventy-One of the Laozi and Descartes's Four Rules