5D Library › Rhythmic Acoustic Stimulation, Auditory Steady-State Responses and Modulation Signal Engineering · 中文
Chapter 6. Evidence: Detection Power, Placebo and Forking Paths
What the literature says
Evidence
Published evidence. Schwarz and Taylor compared steady-state responses to binaural and monaural beats and found that a 40 Hz binaural beat can evoke a measurable response, weaker than the monaural one (Schwarz and Taylor 2005). A systematic review examined 14 studies that measured binaural-beat “entrainment” with EEG or MEG: 5 supported it, 8 contradicted it and 1 gave mixed results, and the authors concluded that the evidence does not yet establish entrainment (Ingendoh et al. 2023). A meta-analysis of cognitive, anxiety and pain outcomes reported an overall positive effect while noting large differences between studies (Garcia-Argibay et al. 2019).
Such disagreement is not surprising. This chapter uses three programs to show that, with the very same stimulus, study design alone can decide the result.
Can a single recording see the response?
For each simulated listener the program makes one complex frequency bin at the stimulation rate (signal plus noise) and ten neighbouring bins with noise only, takes “target-bin power ÷ mean neighbour power” as the test statistic, calibrates the 0.05 threshold on sham listeners, and counts the share of listeners above it for each stimulus.
Calculation
# Chapter 6. p11: Can a single recording show the response at all?
# For each simulated listener the EEG spectrum at the stimulation rate
# is one complex DFT bin: signal s plus complex Gaussian noise, and ten
# neighbouring bins carry noise only. The test statistic is the power
# in the target bin over the mean power of the neighbours; the 0.05
# threshold is calibrated on sham listeners (no drive). Signal power
# per second follows p04: (a^2 / 2) / P(f), with between-listener
# amplitude spread exp(N(0, 0.4)), times the drive: isochronic 1,
# binaural 0.13116, sham 0. Detection rate = share of listeners above
# the sham threshold. 4,000 listeners per cell, fixed seed.
import math
import random
def snr_per_s(fm):
a = 0.15 + 0.35 * math.exp(-((fm - 40.0) / 10.0) ** 2)
return (a * a / 2.0) / (4.0 / fm)
def stat(rng, snr):
amp = math.sqrt(snr)
ph = rng.uniform(0, 2 * math.pi)
re = amp * math.cos(ph) + rng.gauss(0, math.sqrt(0.5))
im = amp * math.sin(ph) + rng.gauss(0, math.sqrt(0.5))
nb = sum(rng.gauss(0, math.sqrt(0.5)) ** 2 +
rng.gauss(0, math.sqrt(0.5)) ** 2 for _ in range(10)) / 10
return (re * re + im * im) / nb
def rate(rng, fm, drive, T, thr, n=4000):
hit = 0
for _ in range(n):
g = math.exp(rng.gauss(0, 0.4))
if stat(rng, snr_per_s(fm) * T * (g * drive) ** 2) > thr:
hit += 1
return hit / n
if __name__ == "__main__":
rng = random.Random(2026)
sham = sorted(stat(rng, 0.0) for _ in range(20000))
thr = sham[int(0.95 * len(sham))]
print(" sham 95th percentile of the statistic: {:.2f}".format(thr))
print("\n rate T (s) isochronic binaural sham")
for fm in (10.0, 40.0):
for T in (10, 60, 300):
r = [rate(rng, fm, d, T, thr) for d in (1.0, 0.13116, 0.0)]
print(" {:4.0f} {:6d} {:12.3f} {:10.3f} {:6.3f}".format(
fm, T, *r))
print("\nReading: an isochronic 40 Hz tone shows up in nearly every")
print("listener within a minute. The same rate as a binaural beat")
print("is barely above the 0.05 false alarm level after ten")
print("seconds and needs minutes of recording; at 10 Hz the")
print("binaural beat stays near chance for the whole five minutes.")
# sham 95th percentile of the statistic: 3.54
#
# rate T (s) isochronic binaural sham
# 10 10 0.107 0.049 0.050
# 10 60 0.355 0.053 0.048
# 10 300 0.831 0.078 0.050
# 40 10 0.903 0.093 0.046
# 40 60 0.999 0.298 0.048
# 40 300 1.000 0.774 0.051
#
# Reading: an isochronic 40 Hz tone shows up in nearly every
# listener within a minute. The same rate as a binaural beat
# is barely above the 0.05 false alarm level after ten
# seconds and needs minutes of recording; at 10 Hz the
# binaural beat stays near chance for the whole five minutes.The sham threshold is 3.54. A 40 Hz isochronic tone shows a response in 0.903 of listeners after 10 s and 0.999 after 60 s; a binaural beat at the same rate reaches only 0.093 after 10 s, 0.298 after 60 s and 0.774 after 300 s. At 10 Hz the isochronic tone reaches 0.831 only after 300 s, and the binaural beat stays near chance for all five minutes (0.078). So a study of 10 Hz binaural beats with a few minutes of recording per person will almost surely find “no entrainment”, while a study at 40 Hz with longer recordings can find “a response”. The two do not contradict each other.
Expectation and sample size
Self-reported calm or focus mixes a true effect with an expectation effect. A before-and-after design with no control sees their sum; a double-blind comparison with a sham track sees only the true effect.
Calculation
# Chapter 6. p12: Expectation, sham control and sample size.
# Self-reported calm after a session mixes a true effect (d_true) with
# an expectation effect (d_exp) in standard deviation units. Designs:
# A. before / after with no control: sees d_true + d_exp;
# B. blinded track vs sham track (same carriers, no beat or no
# gating): sees d_true only.
# Normal approximations, two-sided alpha 0.05:
# power of A with n listeners: Phi(d sqrt(n) - 1.96);
# n per arm for B at power 0.80: 2 (1.96 + 0.8416)^2 / d^2.
import math
def phi(x):
return 0.5 * (1 + math.erf(x / math.sqrt(2)))
if __name__ == "__main__":
d_exp = 0.4
print(" design A (no control), expectation d = {}, true d = 0:"
.format(d_exp))
for n in (15, 30, 60, 120):
print(" n = {:3d} chance of a 'significant' result {:.3f}"
.format(n, phi(d_exp * math.sqrt(n) - 1.96)))
k = 2 * (1.96 + 0.8416) ** 2
print("\n design B (blinded vs sham), listeners per arm for 0.80:")
for d in (0.1, 0.2, 0.3, 0.5):
print(" true d = {:.1f} n per arm = {:5d} total = {:5d}"
.format(d, math.ceil(k / d ** 2), 2 * math.ceil(k / d ** 2)))
print("\n if 30 % of listeners can tell sham from active, and their")
print(" expectation d = 0.4 leaks into B, the apparent effect is")
print(" 0.30 x 0.4 = {:.2f} even when the true effect is zero."
.format(0.30 * 0.4))
print("\nReading: an uncontrolled before and after survey of 60")
print("people will find a 'significant' benefit most of the time")
print("with no true effect at all. A blinded comparison with a sham")
print("track needs hundreds of listeners for a small true effect,")
print("and still needs a check that the blinding held.")
# design A (no control), expectation d = 0.4, true d = 0:
# n = 15 chance of a 'significant' result 0.341
# n = 30 chance of a 'significant' result 0.591
# n = 60 chance of a 'significant' result 0.873
# n = 120 chance of a 'significant' result 0.992
#
# design B (blinded vs sham), listeners per arm for 0.80:
# true d = 0.1 n per arm = 1570 total = 3140
# true d = 0.2 n per arm = 393 total = 786
# true d = 0.3 n per arm = 175 total = 350
# true d = 0.5 n per arm = 63 total = 126
#
# if 30 % of listeners can tell sham from active, and their
# expectation d = 0.4 leaks into B, the apparent effect is
# 0.30 x 0.4 = 0.12 even when the true effect is zero.
#
# Reading: an uncontrolled before and after survey of 60
# people will find a 'significant' benefit most of the time
# with no true effect at all. A blinded comparison with a sham
# track needs hundreds of listeners for a small true effect,
# and still needs a check that the blinding held.With an expectation effect of 0.4 standard deviations and a true effect of 0, a before-and-after study of 60 people finds a “significant” result with chance 0.873, and of 120 people with chance 0.992. A double-blind comparison needs 393 listeners per arm, 786 in all, to find a true effect of 0.2 with power 0.80; an effect of 0.1 needs 1570 per arm. If 30% of listeners can tell the sham from the active track, expectation leaks into the blinded comparison with size 0.12. So the blinding itself must be checked.
Forking paths
EEG studies have many analytic choices: 5 frequency bands, 19 electrodes and 3 time windows make 285 tests. Without fixing in advance which comparison counts, a researcher can always find a “significant” cell (Gelman and Loken 2014).
Calculation
# Chapter 6. p13: Five bands, nineteen electrodes, three windows.
# A null EEG study (no effect anywhere) tests every combination of
# 5 frequency bands x 19 electrodes x 3 time windows = 285 tests at
# two-sided 0.05 (|z| > 1.96). Electrodes within one band and window
# share a common component with correlation rho; bands and windows
# are independent. We simulate 4,000 null studies and report:
# the family-wise error rate (FWER) without correction;
# the expected number of false "significant" cells;
# the FWER under Bonferroni, |z| > z(0.05 / 285);
# the max-statistic threshold that holds the FWER at exactly 0.05.
import math
import random
def z_two_sided(alpha):
lo, hi = 0.0, 10.0
for _ in range(100):
mid = (lo + hi) / 2
if math.erfc(mid / math.sqrt(2)) > alpha:
lo = mid
else:
hi = mid
return (lo + hi) / 2
def study(rng, rho):
zs = []
for _ in range(15):
c = rng.gauss(0, 1)
for _ in range(19):
zs.append(math.sqrt(rho) * c +
math.sqrt(1 - rho) * rng.gauss(0, 1))
return zs
if __name__ == "__main__":
m = 5 * 19 * 3
zb = z_two_sided(0.05 / m)
print(" tests: {} Bonferroni |z| > {:.3f}".format(m, zb))
print(" independent tests: no false hit with chance 0.95^{},"
.format(m))
print(" that is 1 in {:,.0f}".format(1 / 0.95 ** m))
rng = random.Random(99)
print("\n rho FWER raw mean false hits FWER Bonf max-stat z")
for rho in (0.0, 0.5, 0.8):
raw = bon = hits = 0
mx = []
for _ in range(4000):
zs = [abs(z) for z in study(rng, rho)]
h = sum(1 for z in zs if z > 1.96)
hits += h
raw += h > 0
bon += max(zs) > zb
mx.append(max(zs))
mx.sort()
print(" {:3.1f} {:10.3f} {:17.2f} {:11.3f} {:12.3f}".format(
rho, raw / 4000, hits / 4000, bon / 4000, mx[int(0.95 * 4000)]))
print("\nReading: a study that looks everywhere finds a 'significant'")
print("cell almost surely, about fourteen of them on average, even")
print("when nothing happens. Correlation between electrodes lowers")
print("the FWER but not the expected count. Bonferroni or a")
print("max-statistic threshold fixed in advance restores 0.05.")
# tests: 285 Bonferroni |z| > 3.752
# independent tests: no false hit with chance 0.95^285,
# that is 1 in 2,232,402
#
# rho FWER raw mean false hits FWER Bonf max-stat z
# 0.0 1.000 14.27 0.050 3.752
# 0.5 1.000 14.32 0.043 3.715
# 0.8 0.977 14.25 0.022 3.520
#
# Reading: a study that looks everywhere finds a 'significant'
# cell almost surely, about fourteen of them on average, even
# when nothing happens. Correlation between electrodes lowers
# the FWER but not the expected count. Bonferroni or a
# max-statistic threshold fixed in advance restores 0.05.With no effect at all, the chance that independent tests give no false positive is only 1 in 2,232,402, and the average study has 14.27 falsely “significant” cells. Correlation between electrodes does not change the average number of false positives (14.32 at correlation 0.5) and only slightly lowers the chance of at least one (0.977 at correlation 0.8). The Bonferroni threshold 3.752 brings the family-wise error rate back to 0.050 or less; the max-statistic threshold, 3.520 at correlation 0.8, is a little looser and just as valid.
Summary
Published studies disagree largely because of design: rate, recording length, control and analytic freedom are enough to decide the conclusion. A credible study needs a sham control, a check of the blinding, a single pre-registered primary outcome and correction for multiple comparisons.
References
Fan, Y. (2026). Rhythmic Acoustic Stimulation, Auditory Steady-State Responses and Modulation Signal Engineering: Binaural versus Isochronic Envelope Depth, 40-Hz Phase-Locking Bounds and Pink-Noise Spectral Masking [节律声刺激、听觉稳态反应与双耳等时调制工程] (Version 1.0.0). 5D Library. https://doi.org/10.5281/zenodo.24090211 · Licensed under Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0).