What does Dense Data Workbenches conclude, in numbers, about “Alarm Thresholds: Signal Detection, ROC, the Cost Matrix and a Per-Screen Alarm Cap”?

Answer: Harbourbridge's reconciliation back office takes in about 1,200 ledger rows a day, and under the book-wide sample fixed in Chapter 1, 18 of them are real anomalies: amount mismatches, duplicate postings, wrong exchange rates, payments without orders, and orders marked paid with no bank credit. The system gives every row an "anomaly score", and when the score crosses a line, the row turns red. Chapter 3 dealt with how red gets seen before anything else and how many tiers of colour there should be; this chapter deals with where that line should be drawn.

Scope of the numbers: The book is not accounting, audit or legal advice. Marked boxes separate published evidence, runnable calculations, sources and the author's hypotheses, each stating what would refute it; the source studied is the reporting system of the Tang finance minister Liu Yan, given in paraphrase.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 1200, 18

rows per day 1,200; true anomalies 18 (base rate 0.015); clean rows 1,182
rule with d' = 2.0
thitFAhitsmissesfalseflagsPPV
1.00.8410.158715.142.86187.5202.70.075
1.50.6910.066812.455.5579.091.40.136
2.00.5000.02289.009.0026.935.90.251
2.50.3090.00625.5512.457.312.90.431
3.00.1590.00132.8615.141.64.50.642
3.50.0670.00021.2016.800.31.50.814
rule with d' = 2.5
thitFAhitsmissesfalseflagsPPV
1.00.9330.158716.801.20187.5204.30.082
1.50.8410.066815.142.8679.094.10.161
2.00.6910.022812.455.5526.939.30.316
2.50.5000.00629.009.007.316.30.551
3.00.3090.00135.5512.451.67.10.777
3.50.1590.00022.8615.140.33.10.912
two operators on the same audit set (fictional labelled week)
operator A: hit 0.80 FA 0.10 -> d' = 2.123, criterion c = 0.220, beta = 1.595
operator B: hit 0.50 FA 0.02 -> d' = 2.054, criterion c = 1.027, beta = 8.240
Show the full program
# Chapter 4. p40: The four cells of signal detection on one Harbourbridge reconciliation day, per threshold.
# Book-wide fictional sample (Chapter 1, p10): 1,200 ledger rows a day, 18 of them truly anomalous (0.015).
# Each row carries an anomaly score: N(0, 1) on clean rows and N(d', 1) on anomalous rows (the
# equal-variance Gaussian model of signal detection theory). Two rules: the book's working rule
# (d' = 2.0, as in p11) and a sharper reconciliation-gap score (d' = 2.5). No real data is used.
import math
from statistics import NormalDist

Z = NormalDist()
ROWS, ANOM = 1200, 18
CLEAN = ROWS - ANOM
print("rows per day {:,}; true anomalies {} (base rate {:.3f}); clean rows {:,}".format(
    ROWS, ANOM, ANOM / ROWS, CLEAN))
for d in (2.0, 2.5):
    print("rule with d' = {}".format(d))
    print("   t     hit    FA      hits   misses  false   flags   PPV")
    for t in (1.0, 1.5, 2.0, 2.5, 3.0, 3.5):
        hit = 1 - Z.cdf(t - d)
        fa = 1 - Z.cdf(t)
        hits, fas = ANOM * hit, CLEAN * fa
        flags = hits + fas
        print("   {:.1f}  {:.3f}  {:.4f}  {:5.2f}  {:6.2f}  {:6.1f}  {:6.1f}  {:.3f}".format(
            t, hit, fa, hits, ANOM - hits, fas, flags, hits / flags))

print("two operators on the same audit set (fictional labelled week)")
for name, h, f in (("operator A", 0.80, 0.10), ("operator B", 0.50, 0.02)):
    zh, zf = Z.inv_cdf(h), Z.inv_cdf(f)
    dp = zh - zf
    c = -(zh + zf) / 2
    print("   {}: hit {:.2f} FA {:.2f} -> d' = {:.3f}, criterion c = {:.3f}, beta = {:.3f}".format(
        name, h, f, dp, c, math.exp(c * dp)))

Single source and citation

Fan, Y. (2026). Cognitive Unloading of Dense Data Workbenches, Conditional-Format Salience and Zero-Training Error-Proof Form Engineering (Version 0.1.0), Chapter 4: Alarm Thresholds: Signal Detection, ROC, the Cost Matrix and a Per-Screen Alarm Cap. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-138 · v0.1.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026138,
  author    = {Fan, Yafu},
  title     = {Cognitive Unloading of Dense Data Workbenches, Conditional-Format Salience and Zero-Training Error-Proof Form Engineering},
  year      = {2026},
  publisher = {5D Library},
  edition   = {0.1.0},
  note      = {DOI pending}
}

Other chapter answers in this book