What does Thresholds and Budgets for Ambient Adjutants conclude, in numbers, about “Voice Activity Detection: the Endpoint Wait as a Latency Floor”?

Answer: The track holds 498,384 samples, cut into 3,114 frames. The noise floor is estimated at -32.7 dB. There are 1,442 background frames, sitting at the floor (-0.2 dB) with a zero-crossing rate of 0.143. The 1,073 voiced frames sit on average 12.1 dB above the floor with a zero-crossing rate of only 0.060. The 160 fricative frames sit just 3.9 dB above the floor on average, yet their zero-crossing rate reaches 0.468. The 420 frames of within-utterance pauses look almost exactly like the background (-0.2 dB and 0.150). The 19 knock frames are 7.7 dB above the floor, with a zero-crossing rate of 0.351.

Scope of the numbers: Parameters are illustrative and data synthetic; all calculations are generated by the book's 23 standard-library programs. The book is not individual business advice or legal advice; capture is limited to devices and scenes the wearer controls, bystander content is not kept by default or is redacted at once, and no effect on hearing or the body is claimed.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python onlyprinted values that match the answer: -0.2, -32.7, 0.060, 0.143, 0.150, 0.351

track: 498,384 samples, 3,114 frames, 30 utterances
noise floor -32.7 dB
kindframesenergy dB above floormean ZCR
background1,442-0.20.143
click197.70.351
voiced1,07312.10.060
fricative1603.90.468
pause420-0.20.150
fricative frames below +6 dB: 0.906
Show the full program
# Chapter 2. p21: synthetic audio frames, short-time energy and ZCR.
# 8 kHz samples, 20 ms frames (160 samples). Background is low-passed
# Gaussian noise (one-pole, a = 0.9). Utterances hold 2 to 5 words;
# a word is an optional weak fricative (high-passed uniform noise) and
# a voiced stretch (f0 110 to 220 Hz plus two harmonics, sine envelope);
# pauses of 40 to 220 ms sit between words. Gaps between utterances
# may hold a 30 ms click. Kinds: 0 background, 1 click, 2 voiced,
# 3 fricative, 4 in-utterance pause. All parameters are illustrative.
import math
import random

FS, FRAME = 8000, 160


def make_track(rng, noise_sd, n_utt=30):
    x, kind, utts = [], [], []
    st = [0.0, 0.0]

    def bg():
        st[0] = 0.9 * st[0] + rng.gauss(0.0, noise_sd)
        return st[0]

    def gap(ms, k, click=False):
        n = FS * ms // 1000
        c0 = rng.randrange(n) if click else -1
        for t in range(n):
            hit = click and 0 <= t - c0 < 240
            pop = 0.0
            if hit:
                pop = 0.4 * math.exp(-(t - c0) / 60.0) * rng.uniform(-1, 1)
            x.append(bg() + pop)
            kind.append(1 if hit else k)

    def fricative(ms):
        a = rng.uniform(0.02, 0.05)
        for _ in range(FS * ms // 1000):
            w = rng.uniform(-1.0, 1.0)
            x.append(bg() + a * (w - st[1]))
            st[1] = w
            kind.append(3)

    def voiced(ms):
        n = FS * ms // 1000
        a, f0 = rng.uniform(0.12, 0.3), rng.uniform(110.0, 220.0)
        for t in range(n):
            env = math.sin(math.pi * (t + 0.5) / n)
            ph = 2.0 * math.pi * f0 * t / FS
            s = math.sin(ph) + 0.5 * math.sin(2 * ph) + \
                0.25 * math.sin(3 * ph)
            x.append(bg() + a * env * s)
            kind.append(2)

    gap(1000, 0)
    for _ in range(n_utt):
        start = len(x)
        words = rng.randint(2, 5)
        for w in range(words):
            if rng.random() < 0.4:
                fricative(rng.randint(50, 110))
            voiced(rng.randint(120, 320))
            if w < words - 1:
                gap(rng.randint(40, 220), 4)
        utts.append((start, len(x)))
        gap(rng.randint(500, 1400), 0, click=rng.random() < 0.35)
    return x, kind, utts


def features(x):
    out = []
    for f in range(len(x) // FRAME):
        seg = x[f * FRAME:(f + 1) * FRAME]
        e = math.fsum(v * v for v in seg) / FRAME
        zc = 0
        for a, b in zip(seg, seg[1:]):
            if (a >= 0.0) != (b >= 0.0):
                zc += 1
        out.append((10.0 * math.log10(e + 1e-12), zc / (FRAME - 1)))
    return out


def noise_floor(feats):
    first = sorted(e for e, _ in feats[:50])
    return first[len(first) // 2]


if __name__ == "__main__":
    rng = random.Random(40921)
    x, kind, utts = make_track(rng, 0.01)
    feats = features(x)
    floor = noise_floor(feats)
    names = ["background", "click", "voiced", "fricative", "pause"]
    groups = {k: [] for k in range(5)}
    for f, (e, z) in enumerate(feats):
        ks = kind[f * FRAME:(f + 1) * FRAME]
        k = max(range(5), key=ks.count)
        groups[k].append((e - floor, z))
    print("track: {:,} samples, {:,} frames, {} utterances".format(
        len(x), len(feats), len(utts)))
    print("noise floor {:.1f} dB".format(floor))
    print("  kind         frames  energy dB above floor  mean ZCR")
    for k in range(5):
        g = groups[k]
        me = math.fsum(e for e, _ in g) / len(g)
        mz = math.fsum(z for _, z in g) / len(g)
        print("  {:<11} {:>7,}  {:>12.1f}          {:.3f}".format(
            names[k], len(g), me, mz))
    fr = groups[3]
    lo = 0
    for e, _ in fr:
        if e < 6.0:
            lo += 1
    print("fricative frames below +6 dB: {:.3f}".format(lo / len(fr)))

Single source and citation

Fan, Y. (2026). Ambient Multimodal Cognitive Adjutants: Low-Latency Audio-Visual Memory Streams, Proactive Intent Anticipation and Real-Time Decision Support (Version 1.0.0), Chapter 2: Voice Activity Detection: the Endpoint Wait as a Latency Floor. 5D Library. DOI pending

DOI pending · monograph page goes live after publication · 5DL-B-409 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026409,
  author    = {Fan, Yafu},
  title     = {Ambient Multimodal Cognitive Adjutants: Low-Latency Audio-Visual Memory Streams, Proactive Intent Anticipation and Real-Time Decision Support},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  note      = {DOI pending}
}

Other chapter answers in this book