What does Dissolving Entrenched Priors conclude, in numbers, about “Classical Sources: the Frog in the Well and Knowing What One Knows, Bacon's Aphorism 46 and Socrates' Knowledge of His Ignorance”?

Answer: The respondent answers 23 of the forty questions correctly, a share of 0.575. With no pull-back, average confidence is 0.8115, which is 0.2365 above the actual hit rate, and the Brier score is 0.2908, worse than the 0.2500 one would get by answering "fifty-fifty" to everything. Pulling back by half gives average confidence of 0.6966 and a Brier score of 0.2475, just better than fifty-fifty. Pulling back fully gives average confidence of 0.5816, only 0.0066 above the actual rate, and a Brier score of 0.2316.

Scope of the numbers: Parameters are illustrative and all calculations are generated by the book's programs. Not counselling, no clinical service, not personalised business advice; examples concern only beliefs about goods, never political, religious or ethnic questions.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.0066, 0.2316, 0.2365, 0.2475, 0.2500, 0.2908

questions 40, answered right 23 (0.575)
shrink smean confoverconfBrier
0.000.8115+0.23650.2908
0.250.7540+0.17900.2657
0.500.6966+0.12160.2475
0.750.6391+0.06410.2362
1.000.5816+0.00660.2316
saying 0.5 to everything: Brier 0.2500
Show the full program
# Chapter 7. p72: "to know what you know": calibration before and after.
# Synthetic: 40 product questions (ingredients, price parts, customs
# rules). A respondent's chance of being right is p_i; the stated
# confidence is inflated: conf = min(0.99, p_i + 0.25). After the "explain
# how it works" step, confidence is pulled toward the truth by a factor
# s: conf' = p_i + (conf - p_i)(1 - s). Brier score = mean (conf - y)^2
# with y the seeded 0/1 outcome. Overconfidence = mean conf - share right.
# All synthetic and illustrative.
import math
import random

N_Q = 40


def brier(confs, ys):
    return math.fsum((c - y) ** 2 for c, y in zip(confs, ys)) / len(ys)


if __name__ == "__main__":
    rng = random.Random(38773)
    ps = [rng.uniform(0.3, 0.9) for _ in range(N_Q)]
    ys = [1 if rng.random() < p else 0 for p in ps]
    hit = 0
    for y in ys:
        hit += y
    print("questions {}, answered right {} ({:.3f})".format(
        N_Q, hit, hit / N_Q))
    base = [min(0.99, p + 0.25) for p in ps]
    print("  shrink s   mean conf   overconf   Brier")
    for s in (0.0, 0.25, 0.5, 0.75, 1.0):
        cs = [p + (c - p) * (1 - s) for p, c in zip(ps, base)]
        mc = math.fsum(cs) / N_Q
        print("   {:5.2f}     {:.4f}     {:+.4f}   {:.4f}".format(
            s, mc, mc - hit / N_Q, brier(cs, ys)))
    flat = [0.5] * N_Q
    print("  saying 0.5 to everything: Brier {:.4f}".format(
        brier(flat, ys)))

Single source and citation

Fan, Y. (2026). Dissolving Entrenched Priors, Shattering the Illusion of Explanatory Depth and Anti-Backfire Persuasion Mechanics (Version 1.0.0), Chapter 7: Classical Sources: the Frog in the Well and Knowing What One Knows, Bacon's Aphorism 46 and Socrates' Knowledge of His Ignorance. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-387 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026387,
  author    = {Fan, Yafu},
  title     = {Dissolving Entrenched Priors, Shattering the Illusion of Explanatory Depth and Anti-Backfire Persuasion Mechanics},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book