关于「一个词怎么数:词形、词元、词族与马来语的词缀」,《词汇覆盖率与速成边界》给出的定量结论是什么?
结论:「两千词」与「八千词族」之间隔着一个常被省略的计数单位。p31 表明,同一条参考曲线上,98 % 所需的词形数可以是词族数的 1.95 倍到 4.62 倍;而以词族计数的 98 %,在学习者认出派生形式的把握只有一半时,会降到 0.7389 至 0.8167。马来语词缀丰富,p32 用一个只认词典词根的规则集,把三十五个常见词形归入十六个词族;闽南语词缀少,难点转到切分,台罗的连字符是让计数可以重复的办法。下一章离开平均数,去看一页一页的文字:平均 98 % 的覆盖率,落到每一页上会是什么样子?
数据口径:书中参数为示意,全部计算由书中程序生成;本书是非个人化的经营与教学参考,不是针对任何个人或企业的经营建议,也不承诺任何课程能在某个期限内带来流利。 书中以标注框区分已发表的证据、可运行的 Python 计算(19 段程序)、原典与作者的假说。
对照数据表
下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库与结论吻合的打印值: 0.7389, 0.8167, 1.95, 4.62, 98
| families for 98 %: 7998 | |||
| members m | word forms for 95 % | for 98 % | forms/families |
| 1 | 4499 | 7998 | 1.00 |
| 2 | 8748 | 15578 | 1.95 |
| 4 | 15775 | 28267 | 3.53 |
| 6 | 20395 | 36919 | 4.62 |
| top 8000 families, derived forms recognised with prob rho | |||
| m = 2: | rho 1.0 -> 0.9800 | rho 0.8 -> 0.9147 | rho 0.5 -> 0.8167 |
| m = 4: | rho 1.0 -> 0.9800 | rho 0.8 -> 0.8885 | rho 0.5 -> 0.7513 |
| m = 6: | rho 1.0 -> 0.9800 | rho 0.8 -> 0.8836 | rho 0.5 -> 0.7389 |
查看完整验算程序
# Chapter 3. p31: the same text counted in families and in word forms
# Model: F = 20000 word families with frequencies (j + q)^(-s), using
# the reference fit of p23 (s = 2.389, q = 664.5). Each family has m
# members whose shares fall by half from one member to the next (head,
# then derived and inflected forms). We count how many families and
# how many separate word forms a 98 % list needs, and how much a list
# of the top 8000 families covers when a learner recognises a derived
# form of a known family only with probability rho. The member counts
# and rho are illustrative: m = 1 for an analytic language with little
# affixation, larger m for languages such as Malay that build families
# with productive prefixes and suffixes.
import math
F, S, Q = 20000, 2.389, 664.5
def family_freqs():
raw = [(j + Q) ** (-S) for j in range(1, F + 1)]
tot = math.fsum(raw)
return [x / tot for x in raw]
def shares(m):
raw = [0.5 ** i for i in range(m)]
tot = math.fsum(raw)
return [x / tot for x in raw]
def smallest_list(freqs, c):
"""Smallest n with the n largest values summing to at least c."""
srt = sorted(freqs, reverse=True)
lo, hi = 0, len(srt)
while hi - lo > 1:
mid = (lo + hi) // 2
if math.fsum(srt[:mid]) >= c:
hi = mid
else:
lo = mid
return hi
if __name__ == "__main__":
fam = family_freqs()
print("families for 98 %: {}".format(smallest_list(fam, 0.98)))
print("members m word forms for 95 % for 98 % forms/families")
n98f = smallest_list(fam, 0.98)
for m in (1, 2, 4, 6):
w = shares(m)
forms = [f * x for f in fam for x in w]
n95, n98 = smallest_list(forms, 0.95), smallest_list(forms, 0.98)
print(" {:7d} {:19d} {:8d} {:14.2f}".format(
m, n95, n98, n98 / n98f))
print("top 8000 families, derived forms recognised with prob rho")
known = math.fsum(fam[:8000])
for m in (2, 4, 6):
head = shares(m)[0]
row = [" m = {}:".format(m)]
for rho in (1.0, 0.8, 0.5):
row.append("rho {:.1f} -> {:.4f}".format(
rho, known * (head + rho * (1 - head))))
print(" ".join(row))唯一数据源与引用
范雅福(Fan, Y.). (2026). 《二语词汇覆盖率九十八阈值、齐普夫频率曲线与马来语闽南语速成边界母典》第 3 章「一个词怎么数:词形、词元、词族与马来语的词缀」(版本 1.0.0). 5D Library. DOI 待发布
DOI 待发布 · 专著页正式发布后上线(本站暂无专著页) · 5DL-B-228 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026228,
author = {Fan, Yafu},
title = {The 98% Lexical-Coverage Threshold, Zipfian Frequency Curves and Fast-Track Limits for Malay and Hokkien Learners},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
note = {DOI pending}
}