关于「语义保真:表面相似度为何奖励违规」,《极限词合规改写》给出的定量结论是什么?

结论:第五章说明表面相似度奖励违规,按命题槽位打分后与编辑距离相似度的等级相关为负 0.949。

数据口径:在示意参数下,一个极限词要抵消每月 0.010 的出事概率乘以出事成本,需要 0.0333 的相对转化增益;已发表的研究提示吹嘘的作用在不同顾客那里正负相抵,混合模型中增益超过盈亏平衡值的情形只占 0.042。 书中的词表、文案、事实与参数均为示意;全部计算由书中程序生成;本书是非个人化法律建议,也不提供任何绕开平台审核的手法。

English version

对照数据表

下表数字由本章 Python 程序原样打印,可重新运行复现。

original: ben dian zhen pi bao zui jia xuan ze
rewrite               len  levenshtein   dice  jaccard
R1 delete               5      0.556     0.667    0.556
R2 comparative         10      0.500     0.471    0.357
R3 rating fact         13      0.385     0.400    0.400
R4 repurchase fact     13      0.385     0.400    0.294
R5 absolute synonym    11      0.636     0.556    0.538
highest Levenshtein similarity: R5 absolute synonym
highest bigram Dice:            R1 delete
the only non-compliant rewrite is R5
查看完整验算程序
# Chapter 5. p51: surface similarity rewards keeping the violation.
# Model: three surface measures between an original line and five
# rewrites, all on syllables (one syllable = one Chinese character):
# normalised Levenshtein similarity 1 - d / max(len), Dice coefficient
# of syllable bigrams, and Jaccard index of syllable sets. Lines and
# figures in them (ratings, review counts) are illustrative.
ORIG = "ben dian zhen pi bao zui jia xuan ze"
REWRITES = [("R1 delete", "ben dian zhen pi bao"),
            ("R2 comparative", "ben dian zhen pi bao geng shi he tong qin"),
            ("R3 rating fact",
             "ben dian zhen pi bao ping fen 4.8 gong 1236 tiao ping jia"),
            ("R4 repurchase fact",
             "ben dian zhen pi bao jin jiu shi tian fu gou lv 0.18"),
            ("R5 absolute synonym",
             "ben dian zhen pi bao wu ren neng bi xuan ze")]


def lev(a, b):
    prev = list(range(len(b) + 1))
    for i, x in enumerate(a, 1):
        cur = [i]
        for j, y in enumerate(b, 1):
            cur.append(min(prev[j] + 1, cur[j - 1] + 1,
                           prev[j - 1] + (x != y)))
        prev = cur
    return prev[-1]


def bigrams(t):
    return [tuple(t[i:i + 2]) for i in range(len(t) - 1)]


def dice(a, b):
    ba, bb = bigrams(a), bigrams(b)
    pool = list(bb)
    common = 0
    for g in ba:
        if g in pool:
            pool.remove(g)
            common += 1
    return 2.0 * common / (len(ba) + len(bb))


def jaccard(a, b):
    sa, sb = sorted(set(a)), sorted(set(b))
    inter = [x for x in sa if x in sb]
    union = sorted(set(sa) | set(sb))
    return len(inter) / len(union)


o = ORIG.split()
print("original: " + ORIG)
print("rewrite               len  levenshtein   dice  jaccard")
rows = []
for name, line in REWRITES:
    t = line.split()
    lv = 1.0 - lev(o, t) / max(len(o), len(t))
    rows.append((name, len(t), lv, dice(o, t), jaccard(o, t)))
    print("%-20s %4d      %.3f     %.3f    %.3f" % rows[-1])
top = max(rows, key=lambda r: (r[2], r[0]))
print("highest Levenshtein similarity: %s" % top[0])
top = max(rows, key=lambda r: (r[3], r[0]))
print("highest bigram Dice:            %s" % top[0])
print("the only non-compliant rewrite is R5")

唯一数据源与引用

范雅福(Fan, Y.). (2026). 《平台敏感词合规改写、广告法极限词自动机与语义保真转化弹性母典》第 5 章「语义保真:表面相似度为何奖励违规」(版本 1.0.0). 5D Library. DOI 待发布

DOI 待发布 · 专著页正式发布后上线(本站暂无专著页) · 5DL-B-274 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026274,
  author    = {Fan, Yafu},
  title     = {Compliant Rewriting for Platform-Sensitive Terms: Absolute-Term Automata under the Advertising Law, Meaning-Preserving Rewrites and Conversion Elasticity},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

本书其他章节结论