What does Ego Depletion and the Hungry Judges conclude, in numbers, about “The Price of Random Effects: Heterogeneity, Prediction Intervals and Bayes Factors”?

Answer: The random-effects model acknowledges differences between studies, but when small studies are systematically too large it magnifies the bias: in the illustrative data the fixed-effect pool is 0.140, the random-effects pool 0.383, and the weight of the large test falls from 0.694 to 0.157. The prediction interval from −0.078 to 0.844 is far more honest than the confidence interval. Bayes factors show the two replications moderately supporting the null, yet with strong prior belief in the effect the posterior probability remains 0.5565. The next chapter leaves statistical method and turns to four competing explanations of why people might tire, looking for experimental designs that can tell them apart.

Scope of the numbers: Its parameters are illustrative; all calculations are generated by its programs; the book is not psychological or medical advice, and its procedures and tool are non-personalised business guidance. Marked boxes separate published evidence, runnable Python calculations (18 programs), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.140, 0.157, 0.383, 0.694, 0.844

k 13, Q 30.49 on 12 df, tau^2 0.0475, I^2 0.606
fixed effect   d 0.140  95% CI 0.069 to 0.210
random effects d 0.383  95% CI 0.211 to 0.555
95% prediction interval (normal) -0.078 to 0.844
weight of the big replication: fixed 0.694, random 0.157
without the replication: fixed 0.366, random 0.398
studies with n <= 30 per group: 7 of 13
Show the full program
# Chapter 4. p41: Random effects gives small studies a louder voice.
# Thirteen illustrative studies shaped like a depletion literature: many
# small two-group studies with large d, a few larger ones with small d,
# and one 23-lab-sized replication (n = 1,070 per group, d = 0.04).
# Fixed effect versus DerSimonian-Laird random effects: estimate, Q,
# tau^2, I^2, a normal-approximation 95% prediction interval, and the
# weight each model gives the replication. Data illustrative only.
# 随机效应模型把更多权重交给小研究:示意数据。
import math
from statistics import NormalDist

Z975 = NormalDist().inv_cdf(0.975)
STUDIES = [(0.95, 15), (0.80, 18), (0.72, 20), (0.66, 22), (0.58, 25),
           (0.61, 28), (0.45, 30), (0.52, 34), (0.38, 40), (0.30, 50),
           (0.21, 80), (0.10, 120), (0.04, 1070)]


def se_of(d, n):
    return math.sqrt(2 / n + d * d / (4 * n))


def pool(st):
    ds = [d for d, n in st]
    v = [se_of(d, n) ** 2 for d, n in st]
    w = [1 / x for x in v]
    sw = math.fsum(w)
    fe = math.fsum(a * b for a, b in zip(w, ds)) / sw
    q = math.fsum(a * (b - fe) ** 2 for a, b in zip(w, ds))
    k = len(ds)
    c = sw - math.fsum(a * a for a in w) / sw
    tau2 = max(0.0, (q - (k - 1)) / c)
    wr = [1 / (x + tau2) for x in v]
    swr = math.fsum(wr)
    re = math.fsum(a * b for a, b in zip(wr, ds)) / swr
    se_re = 1 / math.sqrt(swr)
    i2 = max(0.0, (q - (k - 1)) / q)
    return dict(fe=fe, se_fe=1 / math.sqrt(sw), re=re, se_re=se_re,
                q=q, tau2=tau2, i2=i2, wfe=w[-1] / sw, wre=wr[-1] / swr)


r = pool(STUDIES)
print("k {}, Q {:.2f} on {} df, tau^2 {:.4f}, I^2 {:.3f}".format(
    len(STUDIES), r["q"], len(STUDIES) - 1, r["tau2"], r["i2"]))
print("fixed effect   d {:.3f}  95% CI {:.3f} to {:.3f}".format(
    r["fe"], r["fe"] - Z975 * r["se_fe"], r["fe"] + Z975 * r["se_fe"]))
print("random effects d {:.3f}  95% CI {:.3f} to {:.3f}".format(
    r["re"], r["re"] - Z975 * r["se_re"], r["re"] + Z975 * r["se_re"]))
half = Z975 * math.sqrt(r["tau2"] + r["se_re"] ** 2)
print("95% prediction interval (normal) {:.3f} to {:.3f}".format(
    r["re"] - half, r["re"] + half))
print("weight of the big replication: fixed {:.3f}, random {:.3f}"
      .format(r["wfe"], r["wre"]))
small = pool(STUDIES[:-1])
print("without the replication: fixed {:.3f}, random {:.3f}".format(
    small["fe"], small["re"]))
nsmall = len([1 for d, n in STUDIES if n <= 30])
print("studies with n <= 30 per group: {} of {}".format(
    nsmall, len(STUDIES)))

Single source and citation

Fan, Y. (2026). The Failed Replication of Ego Depletion, the Ordering Artefact behind the Hungry Judges and Decision-Fatigue Scheduling (Version 1.0.0), Chapter 4: The Price of Random Effects: Heterogeneity, Prediction Intervals and Bayes Factors. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-196 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026196,
  author    = {Fan, Yafu},
  title     = {The Failed Replication of Ego Depletion, the Ordering Artefact behind the Hungry Judges and Decision-Fatigue Scheduling},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book