The Multiplicative Law of Fan-Out Tail Latency and Hedged Requests: How Percentile Latency Amplifies When One Page Makes Many Calls: chapter answers

Website owners commonly believe that if every backend service keeps its slow requests to one per cent, the page experience cannot be too bad. This book overturns that belief with probability models. A page waits for all its calls, so its latency is their maximum, and one slow request in a hundred at each service becomes a slow-page probability of 0.634 with a hundred parallel calls. The number comes from "The Tail at Scale" by Dean and Barroso in Communications of the ACM, 2013; after checking the original, the book corrects the blueprint: it is a consequence computed under independence for a…

DOI pending · monograph page goes live after publication · 5DL-B-326 · 中文版

Illustrative model calculation, not a live quote