The Information Bottleneck and Rate-Distortion Limits: How Far a Bilingual Monograph Can Be Compressed into Guardrails before Discriminative Power Falls Away: chapter answers
When a bilingual monograph is finished, its publisher wants to press it into a few guardrail rules. The commissioning claim was that compression has no free lunch, that the number of guardrail rules has a rate-distortion lower bound, and that beyond a certain compression ratio discriminative power falls off a cliff. This book writes candidate rules as a discrete source and reviewers' verdicts as a relevance variable and tests the claim with rate-distortion theory and the information bottleneck, correcting the blueprint. The sources never speak of a cliff; the optimal curve is concave and cont…
DOI pending · monograph page goes live after publication · 5DL-B-250 · 中文版
- Chapter 1 · The Guardrail Source: Eight Kinds of Draft, Three Verdicts and the Counting Bound on Rules
Chapter 1 builds an illustrative source of eight kinds of draft and three verdicts and the counting bound: three rules keep 0.960 of the verdict information, two only 0.629. - Chapter 2 · The Axis: Cliffs, Concave Curves and the Straight Line under Deterministic Labels
Chapter 2 quantifies the cliff: the cliff in share, 0.331, is 41.7 times the earlier average fall. - Chapter 3 · Blahut and Arimoto: Computing the Rate-Distortion Function of a Guardrail in the Standard Library
Chapter 3 implements Blahut and Arimoto in the standard library, matches the binary closed form digit by digit, and shows that draft-by-draft rules use 0.2620 bits more than the rate-distortion curve. - Chapter 4 · Phase Transitions: Maximal Correlation, the Critical Exchange Rate and Deterministic Annealing
Chapter 4 shows that the critical exchange rate is the reciprocal of the squared maximal correlation, 0.6844 and 1.4610 on the illustrative source while information rises continuously as rules split. - Chapter 5 · From Monograph to Guardrails: Agglomerative Bottlenecks, Five Knee Criteria and Bilingual Redundancy
Chapter 5 uses the agglomerative bottleneck to press forty-eight candidate rules to a knee of five, keeping 0.958; exact bilingual redundancy is the only free lunch, and translation drift pulls the share to 0.948. - Chapter 6 · Opposing Evidence: Finite Samples, Learnt Compression and How Discriminative Power Is Scored
Chapter 6 sets out the opposing evidence: with 50 drafts, 0.920 of repeated runs choose the wrong knee, and six rules learnt from few records keep only 0.017 bits. - Chapter 7 · Classical Sources East and West: "Writing Does Not Exhaust Speech, Speech Does Not Exhaust Intent" and Shannon's Suspension of Meaning
Chapter 7 examines "writing does not exhaust speech, speech does not exhaust intent" from the Xici commentary, Wang Bi's "forget the image once the intent is grasped", and Shannon's decision to set meaning outside the e… - Chapter 8 · Closing the Loop: One Compression-Recall Curve per Volume, a Knee Calculator and a Pre-Registered Protocol
Chapter 8 gives the loop of one compression-recall curve per volume, the distilled "Rule-Compression Knee Calculator" and a paired pre-registered protocol needing 75 to 103 drafts per test when the gap in accuracy is la…
Illustrative model calculation, not a live quote