The Algorithmic Mirror: chapter answers

Why do two people who ask the same language model about the same subject come away with opposite impressions, one finding it shallow and the other a collaborator that opens new lines of thought? This book treats a language model as a learned conditional distribution P(Y|X) and asks, with information theory, machine learning, cybernetics and cognitive psychology, what the asker brings: conditional entropy and mutual information, and why a constraining prompt redirects probability rather than necessarily lowering entropy (correcting the claim that models "collapse to the mean", with the evidenc…

DOI 10.5281/zenodo.23723557 · Read the monograph · 中文版

Illustrative model calculation, not a live quote