Reasoning-Trajectory Profiling, Process-Tracing Games and Separating Cognitive Structure from Stated Intentions and Outcome Luck: chapter answers
Two popular beliefs guide the choice of partners, buyers, clients and seat applicants: hear a person explain why he acted and you can judge him; count his deals won and lost and you know his judgement. This book refutes the first on its own ground and bounds the second. After-the-fact explanations are often folk theories: in a synthetic experiment, retrospective self-reports correlate only -0.013 with the weights used but 0.826 with an observer's guess; concurrent thinking aloud keeps order and leaps. Track records mix judgement with luck: when success rates differ by a tenth, 82 decisions ar…
DOI pending · monograph page goes live after publication · 5DL-B-385 · 中文版
- Chapter 1 · The Limits of Self-Report: After-the-Fact Reasons, Thinking Aloud and Reactivity
Thinking aloud keeps 0.919 of the steps, its Kendall correlation with the real order is 0.977, and 0.968 of reports still show at least one leap. Retrospective recall keeps only 0.648 of the steps, its correlation falls… - Chapter 2 · Four Process-Tracing Tests Written as Likelihood Ratios
With ρ equal to zero, the true ratio for seeing both clues is 4.000, matching naive multiplication, and the posterior is 0.800. At ρ of 0.25 the true ratio falls to 3.024 and the posterior to 0.752; at 0.5 the values ar… - Chapter 3 · The Reasoning Graph: Nodes, Leaps, Backtracks and Revisions
At twelve edges the interval runs from 0.063 to 0.483, with a half-width of 0.210, which says almost nothing. At 48 edges it narrows to 0.111 to 0.333; at 96 edges it is 0.132 to 0.291; at 192 edges the half-width is 0.… - Chapter 4 · Fingerprints under Pressure: Intraclass Correlation and Rater Agreement
With a single-scene coefficient of 0.30, the mean of three scenes reaches only 0.562 and the mean of six 0.720; reaching 0.70 takes 6 scenes and reaching 0.80 takes 10. With a coefficient of 0.45, three scenes give 0.71… - Chapter 5 · The Cost of Forgery: Probing Depth, Memory Load and Bounds on Detection
Chapter 5 models forgery cost: under illustrative parameters, probing to level six flags a performer with probability 0.784 and a genuine reasoner with 0.241, while the claim fails where scripts are ample and reasoning… - Chapter 6 · Stripping Out Outcome Luck: Track Records, Sequential Tests and Multi-Method Composites
Records of success and failure mix the quality of decisions with luck. When sound and weak decision makers differ by a tenth in their success rates, the weak one still shows the better record about three times in ten af… - Chapter 7 · Classical Sources: the Analects on Seeing, Watching and Examining; Bayes and Aristotle on Choice
Chapter 7 reads the Analects on seeing, watching and examining, and on listening to words and watching conduct, Bayes's essay of 1763 and Aristotle on choice. - Chapter 8 · Field Tools and Checker Specifications: the Reasoning-Trajectory Selection Ledger, the Scorer, Pre-Registration and Refutation
Chapter 8 gives field tools and checker specifications: ledger fields, five gates, the distilled Reasoning-Trajectory Process-Tracing and Outcome-Luck Separation Scorer, checks grouped by the four kits, and a pre-regist…
Illustrative model calculation, not a live quote