What does Ego Depletion and the Hungry Judges conclude, in numbers, about “Air in the Funnel: Selective Publication, Egger's Test and PET-PEESE”?
Answer: Chapter 2 simulates a literature whose true effect is zero but which passes through selective publication; a random-effects meta-analysis still returns 0.286, and Egger's test, PET and PEESE detect and correct it.
Scope of the numbers: Its parameters are illustrative; all calculations are generated by its programs; the book is not psychological or medical advice, and its procedures and tool are non-personalised business guidance. Marked boxes separate published evidence, runnable Python calculations (18 programs), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.286
| all run k 1000, significant | 25 (0.025) |
| mean d -0.017, fixed -0.012, random -0.013 [-0.031, 0.006] | |
| tau^2 0.0040, I^2 0.047 | |
| published k | 72, significant 25 (0.347) |
| mean d 0.308, fixed 0.276, random 0.286 [0.207, 0.365] | |
| tau^2 0.0357, I^2 0.315 | |
| share of run studies that were published | 0.072 |
| published mean d: n< | 20 0.352 (k 22), n>30 0.191 (k 25) |
Show the full program
# Chapter 2. p21: A literature built on a true effect of zero.
# 1000 two-group studies, n per group drawn from 10 to 40, true d = 0.
# Every significant positive study is published; a non-significant one
# with probability 0.10 if its sign is positive, 0.02 if negative.
# The published set is pooled by DerSimonian-Laird random effects.
# All parameters are illustrative. Seed fixed.
# 真实效应为零的文献,经选择性发表后被元分析。
import math
import random
from statistics import NormalDist
Z975 = NormalDist().inv_cdf(0.975)
rng = random.Random(20261112)
TRUE_D, K_RUN = 0.0, 1000
P_NS_POS, P_NS_NEG = 0.10, 0.02
def one_study(n, true_d):
a = [rng.gauss(true_d, 1.0) for _ in range(n)]
b = [rng.gauss(0.0, 1.0) for _ in range(n)]
ma, mb = math.fsum(a) / n, math.fsum(b) / n
va = math.fsum((x - ma) ** 2 for x in a) / (n - 1)
vb = math.fsum((x - mb) ** 2 for x in b) / (n - 1)
d = (ma - mb) / math.sqrt((va + vb) / 2)
se = math.sqrt(2 / n + d * d / (4 * n))
return d, se
def dl(ds, ses):
w = [1 / s ** 2 for s in ses]
sw = math.fsum(w)
fe = math.fsum(wi * di for wi, di in zip(w, ds)) / sw
q = math.fsum(wi * (di - fe) ** 2 for wi, di in zip(w, ds))
k = len(ds)
c = sw - math.fsum(wi * wi for wi in w) / sw
tau2 = max(0.0, (q - (k - 1)) / c)
wr = [1 / (s ** 2 + tau2) for s in ses]
re = math.fsum(wi * di for wi, di in zip(wr, ds)) / math.fsum(wr)
se_re = 1 / math.sqrt(math.fsum(wr))
i2 = max(0.0, (q - (k - 1)) / q) if q > 0 else 0.0
return fe, re, se_re, tau2, i2
pub, allst = [], []
for _ in range(K_RUN):
n = rng.randint(10, 40)
d, se = one_study(n, TRUE_D)
allst.append((d, se, n))
sig = d / se > Z975
if sig or rng.random() < (P_NS_POS if d > 0 else P_NS_NEG):
pub.append((d, se, n))
for label, st in (("all run", allst), ("published", pub)):
ds = [s[0] for s in st]
ses = [s[1] for s in st]
fe, re, se_re, tau2, i2 = dl(ds, ses)
nsig = len([1 for d, s in zip(ds, ses) if d / s > Z975])
print("{:9s} k {:3d}, significant {:3d} ({:.3f})".format(
label, len(st), nsig, nsig / len(st)))
print(" mean d {:.3f}, fixed {:.3f}, random {:.3f} [{:.3f}, {:.3f}]"
.format(math.fsum(ds) / len(ds), fe, re,
re - Z975 * se_re, re + Z975 * se_re))
print(" tau^2 {:.4f}, I^2 {:.3f}".format(tau2, i2))
print("share of run studies that were published: {:.3f}".format(
len(pub) / K_RUN))
small = [s for s in pub if s[2] <= 20]
large = [s for s in pub if s[2] > 30]
print("published mean d: n<=20 {:.3f} (k {}), n>30 {:.3f} (k {})".format(
math.fsum(s[0] for s in small) / len(small), len(small),
math.fsum(s[0] for s in large) / len(large), len(large)))Single source and citation
Fan, Y. (2026). The Failed Replication of Ego Depletion, the Ordering Artefact behind the Hungry Judges and Decision-Fatigue Scheduling (Version 1.0.0), Chapter 2: Air in the Funnel: Selective Publication, Egger's Test and PET-PEESE. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-196 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026196,
author = {Fan, Yafu},
title = {The Failed Replication of Ego Depletion, the Ordering Artefact behind the Hungry Judges and Decision-Fatigue Scheduling},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · From 0.62 to 0.04: The Preregistered Replications of Ego Depletion
- Chapter 3 · Hungry Judges or a Sorted Docket: Three Ways to Make an Ordering Artefact
- Chapter 4 · The Price of Random Effects: Heterogeneity, Prediction Intervals and Bayes Factors
- Chapter 5 · Four Fingerprints: Resource, Process, Belief and Ordering
- Chapter 6 · A Decision-Fatigue Schedule: The Rearrangement Inequality and a Dynamic Programme for Breaks
- Chapter 7 · Classical Sources, East and West: Xunzi's "Empty, Unified and Still" and James's "The Energies of Men"
- Chapter 8 · Closing the Loop: An Owner's Decision Log and a Preregistered Plan for Falsification