关于「一个词怎么数:词形、词元、词族与马来语的词缀」,《词汇覆盖率与速成边界》给出的定量结论是什么?

结论:「两千词」与「八千词族」之间隔着一个常被省略的计数单位。p31 表明,同一条参考曲线上,98 % 所需的词形数可以是词族数的 1.95 倍到 4.62 倍;而以词族计数的 98 %,在学习者认出派生形式的把握只有一半时,会降到 0.7389 至 0.8167。马来语词缀丰富,p32 用一个只认词典词根的规则集,把三十五个常见词形归入十六个词族;闽南语词缀少,难点转到切分,台罗的连字符是让计数可以重复的办法。下一章离开平均数,去看一页一页的文字:平均 98 % 的覆盖率,落到每一页上会是什么样子?

数据口径:书中参数为示意,全部计算由书中程序生成;本书是非个人化的经营与教学参考,不是针对任何个人或企业的经营建议,也不承诺任何课程能在某个期限内带来流利。 书中以标注框区分已发表的证据、可运行的 Python 计算(19 段程序)、原典与作者的假说。

English version

对照数据表

下表数字由本章 Python 程序原样打印,可重新运行复现。 程序只用 Python 标准库与结论吻合的打印值: 0.7389, 0.8167, 1.95, 4.62, 98

families for 98 %: 7998
members mword forms for 95 %for 98 %forms/families
1449979981.00
28748155781.95
415775282673.53
620395369194.62
top 8000 families, derived forms recognised with prob rho
m = 2:rho 1.0 -> 0.9800rho 0.8 -> 0.9147rho 0.5 -> 0.8167
m = 4:rho 1.0 -> 0.9800rho 0.8 -> 0.8885rho 0.5 -> 0.7513
m = 6:rho 1.0 -> 0.9800rho 0.8 -> 0.8836rho 0.5 -> 0.7389
查看完整验算程序
# Chapter 3. p31: the same text counted in families and in word forms
# Model: F = 20000 word families with frequencies (j + q)^(-s), using
# the reference fit of p23 (s = 2.389, q = 664.5). Each family has m
# members whose shares fall by half from one member to the next (head,
# then derived and inflected forms). We count how many families and
# how many separate word forms a 98 % list needs, and how much a list
# of the top 8000 families covers when a learner recognises a derived
# form of a known family only with probability rho. The member counts
# and rho are illustrative: m = 1 for an analytic language with little
# affixation, larger m for languages such as Malay that build families
# with productive prefixes and suffixes.
import math

F, S, Q = 20000, 2.389, 664.5


def family_freqs():
    raw = [(j + Q) ** (-S) for j in range(1, F + 1)]
    tot = math.fsum(raw)
    return [x / tot for x in raw]


def shares(m):
    raw = [0.5 ** i for i in range(m)]
    tot = math.fsum(raw)
    return [x / tot for x in raw]


def smallest_list(freqs, c):
    """Smallest n with the n largest values summing to at least c."""
    srt = sorted(freqs, reverse=True)
    lo, hi = 0, len(srt)
    while hi - lo > 1:
        mid = (lo + hi) // 2
        if math.fsum(srt[:mid]) >= c:
            hi = mid
        else:
            lo = mid
    return hi


if __name__ == "__main__":
    fam = family_freqs()
    print("families for 98 %: {}".format(smallest_list(fam, 0.98)))
    print("members m  word forms for 95 %  for 98 %  forms/families")
    n98f = smallest_list(fam, 0.98)
    for m in (1, 2, 4, 6):
        w = shares(m)
        forms = [f * x for f in fam for x in w]
        n95, n98 = smallest_list(forms, 0.95), smallest_list(forms, 0.98)
        print("  {:7d}  {:19d}  {:8d}  {:14.2f}".format(
            m, n95, n98, n98 / n98f))
    print("top 8000 families, derived forms recognised with prob rho")
    known = math.fsum(fam[:8000])
    for m in (2, 4, 6):
        head = shares(m)[0]
        row = ["  m = {}:".format(m)]
        for rho in (1.0, 0.8, 0.5):
            row.append("rho {:.1f} -> {:.4f}".format(
                rho, known * (head + rho * (1 - head))))
        print("  ".join(row))

唯一数据源与引用

范雅福(Fan, Y.). (2026). 《二语词汇覆盖率九十八阈值、齐普夫频率曲线与马来语闽南语速成边界母典》第 3 章「一个词怎么数:词形、词元、词族与马来语的词缀」(版本 1.0.0). 5D Library. DOI 待发布

DOI 待发布 · 专著页正式发布后上线(本站暂无专著页) · 5DL-B-228 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026228,
  author    = {Fan, Yafu},
  title     = {The 98% Lexical-Coverage Threshold, Zipfian Frequency Curves and Fast-Track Limits for Malay and Hokkien Learners},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

本书其他章节结论