What does Chinese Readability conclude, in numbers, about “The Long Tail of Character Frequency: the General Standard Table, a Zipf Model and an Illustrative Frequency-Tier Table”?
Answer: The program first checks that the three levels add up: 3500 plus 3000 plus 1605 equals 8105. The exponent that meets the target coverage of 0.99 is s = 1.3840. In this model the first 1000 characters cover 0.9676, the first 2500 cover 0.9850 and level one covers 0.9900, so 1.00 character in every hundred falls outside level one; levels one and two together, 6500 characters, cover 0.9977.
Scope of the numbers: Parameters are illustrative; all calculations are generated by the book's programs; the book offers general rather than individualised business advice. Chapters 2 and 3 treat common-character lists, an illustrative frequency-tier table and the rules for cutting sentences.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: 0.9676, 0.9850, 0.99, 0.9900, 0.9977, 1.00
| levels 3500 + 3000 + 1605 = 8105 | ||
| Zipf exponent giving level-one coverage 0.99: s = 1.3840 | ||
| top k | coverage | outside per 100 hanzi |
| 100 | 0.8844 | 11.56 |
| 500 | 0.9497 | 5.03 |
| 1000 | 0.9676 | 3.24 |
| 2500 | 0.9850 | 1.50 |
| 3500 | 0.9900 | 1.00 |
| 6500 | 0.9977 | 0.23 |
| 8105 | 1.0000 | 0.00 |
| chance a sentence holds >= 1 hanzi outside the common set | ||
| L | c=0.99 | c=0.95 |
| 4 | 0.0394 | 0.1855 |
| 8 | 0.0773 | 0.3366 |
| 16 | 0.1485 | 0.5599 |
| 25 | 0.2222 | 0.7226 |
| 37 | 0.3106 | 0.8501 |
| 72 | 0.5150 | 0.9751 |
Show the full program
# Chapter 2. p21: how much text the 3500 level-one hanzi cover, in a toy
# Zipf model. Facts: the Table of General Standard Chinese Characters
# (State Council, 2013) lists 8105 hanzi in three levels of 3500, 3000
# and 1605. Model (illustrative): token share of rank r is proportional
# to r^-s over the closed set of 8105; s is solved so that level one
# covers a target share C1 = 0.99 (an assumed round figure, not a
# measured one). A sentence of L independent hanzi then contains at
# least one hanzi outside level one with chance 1 - c^L.
import math
N, LEVELS, C1 = 8105, (3500, 3000, 1605), 0.99
def harmonic(k, s):
return math.fsum(r ** -s for r in range(1, k + 1))
def coverage(k, s):
return harmonic(k, s) / harmonic(N, s)
def solve_s(target, k):
lo, hi = 0.5, 3.0
for _ in range(60):
mid = 0.5 * (lo + hi)
if coverage(k, mid) < target:
lo = mid
else:
hi = mid
return 0.5 * (lo + hi)
if __name__ == "__main__":
print("levels {} + {} + {} = {}".format(*LEVELS, N))
s = solve_s(C1, LEVELS[0])
print("Zipf exponent giving level-one coverage {:.2f}: s = {:.4f}"
.format(C1, s))
print(" top k coverage outside per 100 hanzi")
for k in (100, 500, 1000, 2500, 3500, 6500, 8105):
c = coverage(k, s)
print(" {:5d} {:.4f} {:6.2f}".format(k, c, 100 * (1 - c)))
print("chance a sentence holds >= 1 hanzi outside the common set")
print(" L c=0.99 c=0.95")
for n in (4, 8, 16, 25, 37, 72):
print(" {:3d} {:.4f} {:.4f}".format(
n, 1 - 0.99 ** n, 1 - 0.95 ** n))Single source and citation
Fan, Y. (2026). Chinese Readability from Character Frequency and Sentence Length: Reading Difficulty of Landing Pages and Monograph Paragraphs (Version 1.0.0), Chapter 2: The Long Tail of Character Frequency: the General Standard Table, a Zipf Model and an Illustrative Frequency-Tier Table. 5D Library. DOI pending
DOI pending · monograph page goes live after publication · 5DL-B-323 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026323,
author = {Fan, Yafu},
title = {Chinese Readability from Character Frequency and Sentence Length: Reading Difficulty of Landing Pages and Monograph Paragraphs},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}Other chapter answers in this book
- Chapter 1 · Two Misjudgements of "Shorter Reads Easier": the Plane of Sentence Length and Common-Character Share
- Chapter 3 · Where to Cut a Sentence: Segmentation Rules, Mean and Median
- Chapter 4 · A Simplified Linear Readability Formula: Term-by-Term Decomposition, Calibration and the Collinearity Trap
- Chapter 5 · Reading Difficulty of a Landing Page: Headline, Selling Points and Terms, and Two Levers for Rewriting
- Chapter 6 · Monograph Paragraphs: Glossary Exemption and a Rare-Character Budget
- Chapter 7 · Eastern and Western Classics Examined: the "Choosing Characters" Chapter of Wenxin Diaolong and Flesch 1948
- Chapter 8 · Closing the Loop: Readability Hints for the Copy Checker and the Book Engine, the Chinese Readability Scorer and a Pre-registered Reader Test