What does Dissolving Entrenched Priors conclude, in numbers, about “Classical Sources: the Frog in the Well and Knowing What One Knows, Bacon's Aphorism 46 and Socrates' Knowledge of His Ignorance”?
Answer: The respondent answers 23 of the forty questions correctly, a share of 0.575. With no pull-back, average confidence is 0.8115, which is 0.2365 above the actual hit rate, and the Brier score is 0.2908, worse than the 0.2500 one would get by answering "fifty-fifty" to everything. Pulling back by half gives average confidence of 0.6966 and a Brier score of 0.2475, just better than fifty-fifty. Pulling back fully gives average confidence of 0.5816, only 0.0066 above the actual rate, and a Brier score of 0.2316.
Scope of the numbers: Parameters are illustrative and all calculations are generated by the book's programs. Not counselling, no clinical service, not personalised business advice; examples concern only beliefs about goods, never political, religious or ethnic questions.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.0066, 0.2316, 0.2365, 0.2475, 0.2500, 0.2908
| questions 40, answered right 23 (0.575) | |||
| shrink s | mean conf | overconf | Brier |
| 0.00 | 0.8115 | +0.2365 | 0.2908 |
| 0.25 | 0.7540 | +0.1790 | 0.2657 |
| 0.50 | 0.6966 | +0.1216 | 0.2475 |
| 0.75 | 0.6391 | +0.0641 | 0.2362 |
| 1.00 | 0.5816 | +0.0066 | 0.2316 |
| saying 0.5 to everything: Brier 0.2500 |
Show the full program
# Chapter 7. p72: "to know what you know": calibration before and after.
# Synthetic: 40 product questions (ingredients, price parts, customs
# rules). A respondent's chance of being right is p_i; the stated
# confidence is inflated: conf = min(0.99, p_i + 0.25). After the "explain
# how it works" step, confidence is pulled toward the truth by a factor
# s: conf' = p_i + (conf - p_i)(1 - s). Brier score = mean (conf - y)^2
# with y the seeded 0/1 outcome. Overconfidence = mean conf - share right.
# All synthetic and illustrative.
import math
import random
N_Q = 40
def brier(confs, ys):
return math.fsum((c - y) ** 2 for c, y in zip(confs, ys)) / len(ys)
if __name__ == "__main__":
rng = random.Random(38773)
ps = [rng.uniform(0.3, 0.9) for _ in range(N_Q)]
ys = [1 if rng.random() < p else 0 for p in ps]
hit = 0
for y in ys:
hit += y
print("questions {}, answered right {} ({:.3f})".format(
N_Q, hit, hit / N_Q))
base = [min(0.99, p + 0.25) for p in ps]
print(" shrink s mean conf overconf Brier")
for s in (0.0, 0.25, 0.5, 0.75, 1.0):
cs = [p + (c - p) * (1 - s) for p, c in zip(ps, base)]
mc = math.fsum(cs) / N_Q
print(" {:5.2f} {:.4f} {:+.4f} {:.4f}".format(
s, mc, mc - hit / N_Q, brier(cs, ys)))
flat = [0.5] * N_Q
print(" saying 0.5 to everything: Brier {:.4f}".format(
brier(flat, ys)))Single source and citation
Fan, Y. (2026). Dissolving Entrenched Priors, Shattering the Illusion of Explanatory Depth and Anti-Backfire Persuasion Mechanics (Version 1.0.0), Chapter 7: Classical Sources: the Frog in the Well and Knowing What One Knows, Bacon's Aphorism 46 and Socrates' Knowledge of His Ignorance. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-387 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026387,
author = {Fan, Yafu},
title = {Dissolving Entrenched Priors, Shattering the Illusion of Explanatory Depth and Anti-Backfire Persuasion Mechanics},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · Bounding the Backfire Effect: Corrections Work on Average, Reversals Are Rare
- Chapter 2 · Motivated Discounting: Beta Priors, Pseudo-Samples and Evidence Weights
- Chapter 3 · Rebound and Softening: the Decay of Corrections, Spacing and Half-Life
- Chapter 4 · The Illusion of Explanatory Depth: the Drop on a Seven-Point Scale and the Small Attitude Effect
- Chapter 5 · Self-Affirmation and Benign Thought Experiments: Affirm First, Then Evidence, with an Exit Always Open
- Chapter 6 · Question Sequences as a Decision Process: a Simulated Optimum under Illustrative Parameters and Its Sensitivity
- Chapter 8 · Closing the Loop: the Prior-Dissolving Ledger, Field Tools and Checker Specifications