Active Learning and Uncertainty Sampling: the Fewest Human Labels a Customer-Intent Classifier Needs to Reach Its Target: chapter answers

Online shop owners commonly believe that training a customer-intent classifier takes a few thousand randomly drawn past messages to label, and that more is always better. The counterintuitive claim tested here is that the accuracy random labeling reaches only after more than a thousand labels can often be reached with a fraction of them if the model picks the messages it is least sure of and hands those to a person; but messages picked this way carry a sampling bias, and using them to estimate intent shares, to grade the model or to decide when to stop goes wrong. After checking the sources t…

DOI pending · monograph page goes live after publication · 5DL-B-312 · 中文版

Illustrative model calculation, not a live quote