What does Dense Data Workbenches conclude, in numbers, about “Alarm Thresholds: Signal Detection, ROC, the Cost Matrix and a Per-Screen Alarm Cap”?
Answer: Harbourbridge's reconciliation back office takes in about 1,200 ledger rows a day, and under the book-wide sample fixed in Chapter 1, 18 of them are real anomalies: amount mismatches, duplicate postings, wrong exchange rates, payments without orders, and orders marked paid with no bank credit. The system gives every row an "anomaly score", and when the score crosses a line, the row turns red. Chapter 3 dealt with how red gets seen before anything else and how many tiers of colour there should be; this chapter deals with where that line should be drawn.
Scope of the numbers: The book is not accounting, audit or legal advice. Marked boxes separate published evidence, runnable calculations, sources and the author's hypotheses, each stating what would refute it; the source studied is the reporting system of the Tang finance minister Liu Yan, given in paraphrase.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 1200, 18
| rows per day 1,200; true anomalies 18 (base rate 0.015); clean rows 1,182 | |||||||
| rule with d' = 2.0 | |||||||
| t | hit | FA | hits | misses | false | flags | PPV |
| 1.0 | 0.841 | 0.1587 | 15.14 | 2.86 | 187.5 | 202.7 | 0.075 |
| 1.5 | 0.691 | 0.0668 | 12.45 | 5.55 | 79.0 | 91.4 | 0.136 |
| 2.0 | 0.500 | 0.0228 | 9.00 | 9.00 | 26.9 | 35.9 | 0.251 |
| 2.5 | 0.309 | 0.0062 | 5.55 | 12.45 | 7.3 | 12.9 | 0.431 |
| 3.0 | 0.159 | 0.0013 | 2.86 | 15.14 | 1.6 | 4.5 | 0.642 |
| 3.5 | 0.067 | 0.0002 | 1.20 | 16.80 | 0.3 | 1.5 | 0.814 |
| rule with d' = 2.5 | |||||||
| t | hit | FA | hits | misses | false | flags | PPV |
| 1.0 | 0.933 | 0.1587 | 16.80 | 1.20 | 187.5 | 204.3 | 0.082 |
| 1.5 | 0.841 | 0.0668 | 15.14 | 2.86 | 79.0 | 94.1 | 0.161 |
| 2.0 | 0.691 | 0.0228 | 12.45 | 5.55 | 26.9 | 39.3 | 0.316 |
| 2.5 | 0.500 | 0.0062 | 9.00 | 9.00 | 7.3 | 16.3 | 0.551 |
| 3.0 | 0.309 | 0.0013 | 5.55 | 12.45 | 1.6 | 7.1 | 0.777 |
| 3.5 | 0.159 | 0.0002 | 2.86 | 15.14 | 0.3 | 3.1 | 0.912 |
| two operators on the same audit set (fictional labelled week) | |||||||
| operator A: hit 0.80 FA 0.10 -> d' = 2.123, criterion c = 0.220, beta = 1.595 | |||||||
| operator B: hit 0.50 FA 0.02 -> d' = 2.054, criterion c = 1.027, beta = 8.240 |
Show the full program
# Chapter 4. p40: The four cells of signal detection on one Harbourbridge reconciliation day, per threshold.
# Book-wide fictional sample (Chapter 1, p10): 1,200 ledger rows a day, 18 of them truly anomalous (0.015).
# Each row carries an anomaly score: N(0, 1) on clean rows and N(d', 1) on anomalous rows (the
# equal-variance Gaussian model of signal detection theory). Two rules: the book's working rule
# (d' = 2.0, as in p11) and a sharper reconciliation-gap score (d' = 2.5). No real data is used.
import math
from statistics import NormalDist
Z = NormalDist()
ROWS, ANOM = 1200, 18
CLEAN = ROWS - ANOM
print("rows per day {:,}; true anomalies {} (base rate {:.3f}); clean rows {:,}".format(
ROWS, ANOM, ANOM / ROWS, CLEAN))
for d in (2.0, 2.5):
print("rule with d' = {}".format(d))
print(" t hit FA hits misses false flags PPV")
for t in (1.0, 1.5, 2.0, 2.5, 3.0, 3.5):
hit = 1 - Z.cdf(t - d)
fa = 1 - Z.cdf(t)
hits, fas = ANOM * hit, CLEAN * fa
flags = hits + fas
print(" {:.1f} {:.3f} {:.4f} {:5.2f} {:6.2f} {:6.1f} {:6.1f} {:.3f}".format(
t, hit, fa, hits, ANOM - hits, fas, flags, hits / flags))
print("two operators on the same audit set (fictional labelled week)")
for name, h, f in (("operator A", 0.80, 0.10), ("operator B", 0.50, 0.02)):
zh, zf = Z.inv_cdf(h), Z.inv_cdf(f)
dp = zh - zf
c = -(zh + zf) / 2
print(" {}: hit {:.2f} FA {:.2f} -> d' = {:.3f}, criterion c = {:.3f}, beta = {:.3f}".format(
name, h, f, dp, c, math.exp(c * dp)))Single source and citation
Fan, Y. (2026). Cognitive Unloading of Dense Data Workbenches, Conditional-Format Salience and Zero-Training Error-Proof Form Engineering (Version 0.1.0), Chapter 4: Alarm Thresholds: Signal Detection, ROC, the Cost Matrix and a Per-Screen Alarm Cap. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-138 · v0.1.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026138,
author = {Fan, Yafu},
title = {Cognitive Unloading of Dense Data Workbenches, Conditional-Format Salience and Zero-Training Error-Proof Form Engineering},
year = {2026},
publisher = {5D Library},
edition = {0.1.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · Method: Three Losses, Four Metrics, Evidence Grades and the Liu Yan Reporting System
- Chapter 2 · Scan Paths and the Skeleton of a Table: Column Order, Alignment, Frozen Panes and Density
- Chapter 3 · Preattentive Salience: Let the Anomalies Jump Out, and Only the Anomalies
- Chapter 6 · Zero-Training Error-Proof Forms: Constraints, Defaults, Inline Validation, Confirm-or-Undo and Batch Guards
- Chapter 7 · The Workbench Playbook: Reconciliation, Orders, Stock and Customer Records, and the Distillation Spec
- Chapter 8 · Practice: Rebuilding the Harbourbridge Reconciliation Back Office from Diagnosis to Redesign