What does Calibration and Collective Intelligence conclude, in numbers, about “Reference-Class Forecasting and the Planning Fallacy”?
Answer: The planning fallacy is the tendency to take the inside view and underestimate time and cost systematically; students took longer to write their theses than even their "worst case" estimates. Almost nine in ten (86 %) of 258 transport projects overran their costs, by an average of 44.7 % for rail, 33.8 % for bridges and tunnels and 20.4 % for roads, owing both to optimism bias and to strategic misrepresentation. Reference-class forecasting first finds the distribution of outcomes for similar projects and then places the case within it; a synthetic model shows that the uplift depends on the risk one will accept, and should come from a real empirical distribution. Empirical-Bayes shrinkage combines a team's own record with the reference class according to its reliability, and clearly beats relying on one's own record when records are short and noisy. The next chapter turns from individuals to groups.
Scope of the numbers: This book is not counselling, medical or investment advice. Marked boxes separate published evidence, runnable Python calculations (16 programs, all checked), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python only
| lognormal mu | 0.3355, sigma = 0.2609; synthetic class mean overrun 45.2% |
| synthetic projects over budget | 1809 of 2000 |
| inside-view budget 100; outside-view median outcome 140.0 | |
| accept risk of overrun | budget needed | uplift | |
| 50% | | 140.0 | +40% |
| 30% | | 162.3 | +62% |
| 20% | | 175.5 | +75% |
| 10% | | 195.9 | +96% |
Show the full program
# Synthetic reference class: 2,000 lognormal overrun ratios with the rail mean 44.7 %
# and SD 38.4 points of Flyvbjerg et al. (2002). The lognormal shape is an assumption,
# not their data.
import math, random
rng = random.Random(2002)
MEAN, SD = 1.447, 0.384
S2 = math.log(1 + (SD / MEAN) ** 2)
MU, SIG = math.log(MEAN) - S2 / 2, math.sqrt(S2)
def sample(n=2000):
return sorted(math.exp(rng.gauss(MU, SIG)) for _ in range(n))
def quantile(xs, q):
i = q * (len(xs) - 1)
lo = int(i)
return xs[lo] + (xs[min(lo + 1, len(xs) - 1)] - xs[lo]) * (i - lo)
if __name__ == "__main__":
xs = sample()
print(f"lognormal mu = {MU:.4f}, sigma = {SIG:.4f}; synthetic class mean overrun "
f"{sum(xs) / len(xs) - 1:.1%}")
over = sum(x > 1 for x in xs)
print(f"synthetic projects over budget: {over} of {len(xs)}")
est = 100.0
med = est * quantile(xs, 0.5)
print(f"inside-view budget {est:.0f}; outside-view median outcome {med:.1f}")
print(" accept risk of overrun | budget needed | uplift")
for risk in (0.50, 0.30, 0.20, 0.10):
b = est * quantile(xs, 1 - risk)
print(f" {risk:.0%} | {b:6.1f} | {b / est - 1:+.0%}")Single source and citation
Fan, Y. (2026). Probabilistic Judgement, Brier-Score Calibration and the Statistics of Collective Intelligence (Version 1.0.0), Chapter 5: Reference-Class Forecasting and the Planning Fallacy. 5D Library. https://doi.org/10.5281/zenodo.23764998
DOI: 10.5281/zenodo.23764998 · Read the monograph · 5DL-B-026 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026026,
author = {Fan, Yafu},
title = {Probabilistic Judgement, Brier-Score Calibration and the Statistics of Collective Intelligence},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.23764998},
url = {https://doi.org/10.5281/zenodo.23764998}
}Other chapter answers in this book
- Chapter 1 · Tetlock's Forecasting Research: Experts, Foxes and Superforecasters
- Chapter 2 · Strictly Proper Scoring Rules: The Brier Score and Murphy's Decomposition
- Chapter 3 · Base-Rate Neglect and Natural Frequencies
- Chapter 4 · Signal Detection Theory: Seeing Clearly and Where to Set the Threshold
- Chapter 6 · The Statistics of Collective Intelligence
- Chapter 8 · Practice and a Pre-registered Trial