What does Ego Depletion and the Hungry Judges conclude, in numbers, about “Air in the Funnel: Selective Publication, Egger's Test and PET-PEESE”?

Answer: Chapter 2 simulates a literature whose true effect is zero but which passes through selective publication; a random-effects meta-analysis still returns 0.286, and Egger's test, PET and PEESE detect and correct it.

Scope of the numbers: Its parameters are illustrative; all calculations are generated by its programs; the book is not psychological or medical advice, and its procedures and tool are non-personalised business guidance. Marked boxes separate published evidence, runnable Python calculations (18 programs), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.286

all run k 1000, significant25 (0.025)
mean d -0.017, fixed -0.012, random -0.013 [-0.031, 0.006]
tau^2 0.0040, I^2 0.047
published k72, significant 25 (0.347)
mean d 0.308, fixed 0.276, random 0.286 [0.207, 0.365]
tau^2 0.0357, I^2 0.315
share of run studies that were published0.072
published mean d: n<20 0.352 (k 22), n>30 0.191 (k 25)
Show the full program
# Chapter 2. p21: A literature built on a true effect of zero.
# 1000 two-group studies, n per group drawn from 10 to 40, true d = 0.
# Every significant positive study is published; a non-significant one
# with probability 0.10 if its sign is positive, 0.02 if negative.
# The published set is pooled by DerSimonian-Laird random effects.
# All parameters are illustrative. Seed fixed.
# 真实效应为零的文献,经选择性发表后被元分析。
import math
import random
from statistics import NormalDist

Z975 = NormalDist().inv_cdf(0.975)
rng = random.Random(20261112)
TRUE_D, K_RUN = 0.0, 1000
P_NS_POS, P_NS_NEG = 0.10, 0.02


def one_study(n, true_d):
    a = [rng.gauss(true_d, 1.0) for _ in range(n)]
    b = [rng.gauss(0.0, 1.0) for _ in range(n)]
    ma, mb = math.fsum(a) / n, math.fsum(b) / n
    va = math.fsum((x - ma) ** 2 for x in a) / (n - 1)
    vb = math.fsum((x - mb) ** 2 for x in b) / (n - 1)
    d = (ma - mb) / math.sqrt((va + vb) / 2)
    se = math.sqrt(2 / n + d * d / (4 * n))
    return d, se


def dl(ds, ses):
    w = [1 / s ** 2 for s in ses]
    sw = math.fsum(w)
    fe = math.fsum(wi * di for wi, di in zip(w, ds)) / sw
    q = math.fsum(wi * (di - fe) ** 2 for wi, di in zip(w, ds))
    k = len(ds)
    c = sw - math.fsum(wi * wi for wi in w) / sw
    tau2 = max(0.0, (q - (k - 1)) / c)
    wr = [1 / (s ** 2 + tau2) for s in ses]
    re = math.fsum(wi * di for wi, di in zip(wr, ds)) / math.fsum(wr)
    se_re = 1 / math.sqrt(math.fsum(wr))
    i2 = max(0.0, (q - (k - 1)) / q) if q > 0 else 0.0
    return fe, re, se_re, tau2, i2


pub, allst = [], []
for _ in range(K_RUN):
    n = rng.randint(10, 40)
    d, se = one_study(n, TRUE_D)
    allst.append((d, se, n))
    sig = d / se > Z975
    if sig or rng.random() < (P_NS_POS if d > 0 else P_NS_NEG):
        pub.append((d, se, n))
for label, st in (("all run", allst), ("published", pub)):
    ds = [s[0] for s in st]
    ses = [s[1] for s in st]
    fe, re, se_re, tau2, i2 = dl(ds, ses)
    nsig = len([1 for d, s in zip(ds, ses) if d / s > Z975])
    print("{:9s} k {:3d}, significant {:3d} ({:.3f})".format(
        label, len(st), nsig, nsig / len(st)))
    print("   mean d {:.3f}, fixed {:.3f}, random {:.3f} [{:.3f}, {:.3f}]"
          .format(math.fsum(ds) / len(ds), fe, re,
                  re - Z975 * se_re, re + Z975 * se_re))
    print("   tau^2 {:.4f}, I^2 {:.3f}".format(tau2, i2))
print("share of run studies that were published: {:.3f}".format(
    len(pub) / K_RUN))
small = [s for s in pub if s[2] <= 20]
large = [s for s in pub if s[2] > 30]
print("published mean d: n<=20 {:.3f} (k {}), n>30 {:.3f} (k {})".format(
    math.fsum(s[0] for s in small) / len(small), len(small),
    math.fsum(s[0] for s in large) / len(large), len(large)))

Single source and citation

Fan, Y. (2026). The Failed Replication of Ego Depletion, the Ordering Artefact behind the Hungry Judges and Decision-Fatigue Scheduling (Version 1.0.0), Chapter 2: Air in the Funnel: Selective Publication, Egger's Test and PET-PEESE. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-196 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026196,
  author    = {Fan, Yafu},
  title     = {The Failed Replication of Ego Depletion, the Ordering Artefact behind the Hungry Judges and Decision-Fatigue Scheduling},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book