What does Structural Holes, Knowledge Transfer and Inspiration conclude, in numbers, about “Two Parts of the Score: Semantic Span and Predictive Gain”?
Answer: Chapter 4 shows that Jensen-Shannon span is bounded at 1 bit and saturates, and that the winner among 200 analogies chosen by in-sample fit has an R-squared of 0.283 that shrinks to 0.046 on fresh data.
Scope of the numbers: Its networks, fields, scores and potentials are illustrative models; all calculations are generated by its programs; the book is not investment, medical or psychological advice. Marked boxes separate published evidence, runnable Python calculations (16 programs), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.046, 0.283
| mean in-sample R^2 of the winner | 0.283 |
| mean in-sample R^2 of the real one 0.128 | |
| share of runs the real one wins | 0.110 |
| winner's R^2 on fresh data | 0.046 |
Show the full program
# Chapter 4. p08: "Predictive gain" after searching many analogies. A
# target field has n = 30 observations. 200 candidate analogies each
# supply a predictor; 199 are unrelated, one is real with a true R^2 of
# 0.10. We pick the candidate with the largest in-sample R^2 and test it
# on 30 fresh observations. 1,000 repetitions, fixed seed 102.
import math
import random
rng = random.Random(102)
N, CANDS, REPS = 30, 200, 1000
B = (0.10 / 0.90) ** 0.5 # slope giving true R^2 = 0.10
def r2(x, y):
mx, my = math.fsum(x) / len(x), math.fsum(y) / len(y)
sxy = math.fsum((a - mx) * (b - my) for a, b in zip(x, y))
sxx = math.fsum((a - mx) ** 2 for a in x)
syy = math.fsum((b - my) ** 2 for b in y)
return sxy * sxy / (sxx * syy)
def sample(real):
x = [rng.gauss(0, 1) for _ in range(N)]
y = [(B * a if real else 0.0) + rng.gauss(0, 1) for a in x]
return x, y
if __name__ == "__main__":
best_in = best_out = real_in = 0.0
picked_real = 0
for _ in range(REPS):
xs = [rng.gauss(0, 1) for _ in range(N)]
z = [rng.gauss(0, 1) for _ in range(N)]
y = [B * a + e for a, e in zip(xs, z)]
scores = [(r2(xs, y), 0)]
for k in range(1, CANDS):
scores.append((r2([rng.gauss(0, 1) for _ in range(N)], y), k))
s, k = max(scores)
best_in += s / REPS
real_in += scores[0][0] / REPS
picked_real += (k == 0)
xo, yo = sample(k == 0)
best_out += r2(xo, yo) / REPS
print(" mean in-sample R^2 of the winner {:.3f}".format(best_in))
print(" mean in-sample R^2 of the real one {:.3f}".format(real_in))
print(" share of runs the real one wins {:.3f}".format(
picked_real / REPS))
print(" winner's R^2 on fresh data {:.3f}".format(best_out))Single source and citation
Fan, Y. (2026). Cross-Disciplinary Structural Holes, Functorial Knowledge Transfer and Inspiration Stochastic Resonance (Version 1.0.0), Chapter 4: Two Parts of the Score: Semantic Span and Predictive Gain. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-102 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026102,
author = {Fan, Yafu},
title = {Cross-Disciplinary Structural Holes, Functorial Knowledge Transfer and Inspiration Stochastic Resonance},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · Structural Holes: Where Bridging Ideas Come From
- Chapter 2 · Distance Buys Variance, Not a Better Average
- Chapter 3 · Functors and Their Limits: What a Shared Operator Transfers
- Chapter 5 · When the Score Becomes the Target
- Chapter 6 · Noise, Escape and Keeping: Kramers and the Incubation Claim
- Chapter 7 · Su Shi, the Appended Phrases, Poincaré and Wallas
- Chapter 8 · Practice: A Monthly Pipeline and Its Calibration