What does Critical Transitions and Resilience conclude, in numbers, about “The Limits of Early Warning: Signal to Noise, Selection Bias and Flips Without Warning”?

Answer: Warning indicators must be judged by detection and false-alarm rates together. In the grazing model, with dense records spanning the whole change, Kendall's \(\tau\) for variance and autocorrelation separates well (AUC 0.98 and 0.94), but holding false alarms to 5 % needs a cut-off of about 0.8; with sparser records autocorrelation fails first, and with only the last short stretch both are close to a coin toss. Noise-induced flips and flickering can happen far from a threshold; selecting only series that have collapsed makes us "see" warnings in a system whose parameters never changed. In 126 real data sets true positives were rare and false positives commoner than false negatives. The next chapter takes another angle: instead of forecasting when a threshold will arrive, it asks how far away the threshold is and how that distance can be increased.

Scope of the numbers: The book is not medical advice and makes no investment or financial forecasts; its business and physiological examples are analogies. Marked boxes separate published evidence, runnable Python calculations (15 programs, all checked), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.94, 0.98

designindicatorAUCdetected at 5 % false alarms(tau cut-off)
every unit, 1,000 ptsAC(1)0.9466%(+0.82)
every unit, 1,000 ptsvariance0.9886%(+0.79)
every 5th unit, 200 ptsAC(1)0.6616%(+0.74)
every 5th unit, 200 ptsvariance0.9052%(+0.79)
last 200 units, 200 ptsAC(1)0.545%(+0.82)
last 200 units, 200 ptsvariance0.568%(+0.77)
null series with AC(1) tau > 0.5: 26%; largest null tau +0.90
Show the full program
# ROC of Kendall's tau of rolling AC(1), variance (Boettiger & Hastings 2012, J R Soc Interface).
# Grazing model, sigma = 0.15, 1,000 time units; "approaching": c rises 1.0 -> 2.5 (fold at
# 2.604); "null": c stays at 1.0. Three views of the same runs: every unit (1,000 points),
# every 5th unit (200 points), only the last 200 units (200 points). 200 series each.
import math, random
rng = random.Random(6)

def simulate(ramp, T=1000, sigma=0.15, dt=0.1):
    x, out = 8.9, []
    for t in range(T):
        c = 1.0 + (1.5 * t / T if ramp else 0.0)
        for _ in range(10):
            x += ((x * (1 - x / 10) - c * x * x / (x * x + 1)) * dt
                  + sigma * math.sqrt(dt) * rng.gauss(0, 1))
        out.append(x)
    return out

def detrend(y, bw):
    k = [(d, math.exp(-0.5 * (d / bw) ** 2)) for d in range(-2 * bw, 2 * bw + 1)]
    out = []
    for i in range(len(y)):
        ok = [(w, y[i + d]) for d, w in k if 0 <= i + d < len(y)]
        out.append(y[i] - sum(w * u for w, u in ok) / sum(w for w, _ in ok))
    return out

def stats(w):
    m = sum(w) / len(w); v = sum((u - m) ** 2 for u in w)
    return sum((w[i] - m) * (w[i + 1] - m) for i in range(len(w) - 1)) / v, v / len(w)

def kendall(y):
    s = sum((y[j] > y[i]) - (y[j] < y[i]) for i in range(len(y)) for j in range(i + 1, len(y)))
    return s / (len(y) * (len(y) - 1) / 2)

def taus(y):
    r = detrend(y, max(3, len(y) // 40)); win = len(r) // 2; step = max(1, win // 25)
    a, v = zip(*(stats(r[i - win:i]) for i in range(win, len(r) + 1, step)))
    return kendall(a), kendall(v)

def auc(pos, neg):                    # P(score of an approaching series > score of a null one)
    return sum((p > q) + 0.5 * (p == q) for p in pos for q in neg) / (len(pos) * len(neg))

def tpr_at(pos, neg, fpr=0.05):
    thr = sorted(neg)[int(math.ceil((1 - fpr) * len(neg))) - 1]
    return sum(p > thr for p in pos) / len(pos), thr

DESIGNS = (("every unit, 1,000 pts", lambda y: y), ("every 5th unit, 200 pts", lambda y: y[::5]),
           ("last 200 units, 200 pts", lambda y: y[-200:]))

def run(n=200):
    series = {k: [simulate(k) for _ in range(n)] for k in (True, False)}
    return {name: {k: [taus(view(y)) for y in v] for k, v in series.items()}
            for name, view in DESIGNS}

if __name__ == "__main__":
    res = run()
    print("design                    indicator   AUC   detected at 5 % false alarms  (tau cut-off)")
    for name, _ in DESIGNS:
        for j, lab in ((0, "AC(1)"), (1, "variance")):
            pos = [t[j] for t in res[name][True]]; neg = [t[j] for t in res[name][False]]
            tp, thr = tpr_at(pos, neg)
            print(f"{name:25s} {lab:9s}  {auc(pos, neg):.2f}         {tp:4.0%}"
                  f"                    ({thr:+.2f})")
    neg = [t[0] for t in res[DESIGNS[0][0]][False]]
    print(f"null series with AC(1) tau > 0.5: {sum(t > 0.5 for t in neg) / len(neg):.0%}"
          f"; largest null tau {max(neg):+.2f}")

Single source and citation

Fan, Y. (2026). Phase Transitions, Critical Slowing Down and Resilience in Complex Dynamical Systems (Version 1.0.0), Chapter 3: The Limits of Early Warning: Signal to Noise, Selection Bias and Flips Without Warning. 5D Library. https://doi.org/10.5281/zenodo.23770082

DOI: 10.5281/zenodo.23770082 · Read the monograph · 5DL-B-028 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026028,
  author    = {Fan, Yafu},
  title     = {Phase Transitions, Critical Slowing Down and Resilience in Complex Dynamical Systems},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.23770082},
  url       = {https://doi.org/10.5281/zenodo.23770082}
}

Other chapter answers in this book