The Minimum Description Length Principle and Ockham's Razor for Rule Bases: Two-Part Codes that Decide Whether a New Rule Earns Its Place: chapter answers

Whoever runs a rule base is tempted to believe that more rules mean better coverage. This book overturns that piece of common sense: a new rule deserves a place only if the bits it saves in encoding the exceptions exceed the bits needed to describe the rule itself. The grounds are Rissanen's principle of shortest data description, published in Automatica in 1978, and Grünwald's monograph of 2007. After checking the sources, the book corrects its blueprint: Rissanen's paper concerns statistical model selection, and its use for rule bases is later work; "saves more than it costs" is the criteri…

DOI pending · monograph page goes live after publication · 5DL-B-311 · 中文版

Illustrative model calculation, not a live quote