What does The Explanatory-Depth Razor conclude, in numbers, about “The Boundary of the Illusion of Explanatory Depth: Strongest for Mechanisms, Weakest for Facts”?
Answer: Chapter 1 measures, in synthetic data, a drop of 1.283 points in self-rated understanding of devices against an interval for facts from -0.263 to 0.063 that includes zero.
Scope of the numbers: Parameters are illustrative, all data are synthetic, and every calculation is generated by the book's programs. Chapter 1 measures, in synthetic data, a drop of 1.283 points in self-rated understanding of devices against an interval for facts from -0.263 to 0.063 that includes zero.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: -0.263, 0.063, 1.283
| domain | T1 | T2 | drop | sd | d_z | 95% CI of drop | >=1 | |
| device | 4.53 | 3.25 | 1.283 | 1.04 | 1.24 | [ 1.098, | 1.469] | 0.78 |
| natural | 4.47 | 3.63 | 0.833 | 1.00 | 0.83 | [ 0.655, | 1.012] | 0.59 |
| procedure | 4.41 | 4.08 | 0.325 | 1.06 | 0.31 | [ 0.135, | 0.515] | 0.45 |
| narrative | 4.55 | 4.30 | 0.250 | 0.99 | 0.25 | [ 0.073, | 0.427] | 0.38 |
| fact | 4.24 | 4.34 -0.100 | 0.91 -0.11 | [-0.263, | 0.063] | 0.24 | ||
| raters per domain: 120; drop = T1 - T2 on a 1-7 scale |
Show the full program
# Chapter 1. p11: rating drop after writing the mechanism, by domain.
# Model: each synthetic rater gives a 1-7 self-rating of understanding (T1),
# writes an explanation, then rates again (T2). The latent drop has a mean
# that depends on the knowledge domain. The means are illustrative and only
# follow the direction reported by Rozenblit & Keil (2002): largest for
# devices and natural phenomena, small for procedures, narratives and facts.
# Ratings are rounded and clipped to 1..7, as on a real seven-point scale.
import math
import random
import statistics
rng = random.Random(39611)
N = 120 # raters per domain (illustrative)
DOMAINS = [ # (label, mean T1, mean latent drop)
("device", 4.6, 1.10),
("natural", 4.3, 0.90),
("procedure", 4.4, 0.40),
("narrative", 4.5, 0.20),
("fact", 4.2, 0.10),
]
SD_T1, SD_DROP = 1.0, 0.9
def clip7(x):
return min(7, max(1, int(round(x))))
print("domain T1 T2 drop sd d_z 95% CI of drop >=1")
for label, m1, md in DOMAINS:
drops, t1s, t2s = [], [], []
for _ in range(N):
a = rng.gauss(m1, SD_T1)
t1 = clip7(a)
t2 = clip7(a - rng.gauss(md, SD_DROP))
t1s.append(t1)
t2s.append(t2)
drops.append(t1 - t2)
mean = statistics.fmean(drops)
sd = statistics.stdev(drops)
se = sd / math.sqrt(N)
lo, hi = mean - 1.96 * se, mean + 1.96 * se
share = len([d for d in drops if d >= 1]) / N
print("{:<9} {:5.2f} {:5.2f} {:6.3f} {:5.2f} {:5.2f} [{:6.3f}, {:6.3f}]"
" {:4.2f}".format(label, statistics.fmean(t1s),
statistics.fmean(t2s), mean, sd, mean / sd,
lo, hi, share))
print("raters per domain: {}; drop = T1 - T2 on a 1-7 scale".format(N))Single source and citation
Fan, Y. (2026). Shattering the Illusion of Explanatory Depth, Epistemic Calibration and the Razor Separating True Knowledge from Assumed Familiarity (Version 1.0.0), Chapter 1: The Boundary of the Illusion of Explanatory Depth: Strongest for Mechanisms, Weakest for Facts. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-396 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026396,
author = {Fan, Yafu},
title = {Shattering the Illusion of Explanatory Depth, Epistemic Calibration and the Razor Separating True Knowledge from Assumed Familiarity},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 2 · Calibration, Not Confidence: the Brier Score, Murphy's Decomposition and the Statistical Artefact in the Dunning-Kruger Chart
- Chapter 3 · The Four-Step Razor: Causal Chain, Order of Magnitude, Failure Boundary and Counterexample
- Chapter 4 · Scoring the Assumption List and the Value of Information: Which Assumption to Test First
- Chapter 5 · Reasons Against, the Premortem and Sealing the Ledger against Hindsight
- Chapter 6 · Turning "Fatal" and "Stripping" into Intervals: a Band of Decision Loss, a Small Effect and the Conditions for Refutation
- Chapter 7 · Reading the Classics: the Xunzi on Dispelling Obsession, Chapter Seventy-One of the Laozi and Descartes's Four Rules
- Chapter 8 · Field Tools and Checker Specifications: the False-Knowledge Register, the Four-Step Razor Scorer and a Pre-Registered Test