What does Psychophysics and Multisensory Integration conclude, in numbers, about “Bayesian Optimal Multisensory Integration”?

Answer: Maximum-likelihood integration weights each sense by its precision; the combined estimate is more precise than any single sense, and the gain is largest, a standard deviation shrunk to \(1/\sqrt 2\), when the senses are equally reliable. The visual–haptic experiment of Ernst and Banks and the audiovisual localisation experiment of Alais and Burr both came close to the model's predictions, and the latter showed that sound takes over the judgement of position when vision is blurred enough. But these experiments had very few observers (four and six), individual observers often fall short of the predicted gain, children do not integrate optimally before about 8 to 10 years, and adult experiments have also found over-reliance on vision and departures from maximum-likelihood weights. "Optimal" holds only within the model's assumptions, the most important of which is that the two signals share a source.

Scope of the numbers: This book is not medical advice and cannot diagnose any sensory or neurological condition. Marked boxes separate published evidence, runnable Python calculations (17 programs, all checked), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it. standard-library Python only

haptic threshold 4.68 mm
noise T_V w_V T_VH best single felt height (V +3, H -3 mm)
0%2.20 0.82 1.99 2.20 +1.91 mm
67%5.15 0.45 3.46 4.68 -0.29 mm
133%8.05 0.25 4.04 4.68 -1.49 mm
200%11.00 0.15 4.30 4.68 -2.08 mm
simulated combined spread at 67 %3.46 (formula 3.46)
three ways a perceiver might use two cues (no conflict), threshold in mm:
noise optimal touch only alternate 5050 fixed 50:50 average
0%1.99 4.68 3.65 2.58
67%3.46 4.68 4.92 3.48
133%4.04 4.68 6.58 4.66
200%4.30 4.68 8.45 5.98

Key formula

\[\hat s = w_V\hat s_V + w_H\hat s_H,\qquad w_V = \frac{1/\sigma_V^2}{1/\sigma_V^2 + 1/\sigma_H^2},\quad w_H = 1 - w_V .\]
Show the full program
# Maximum-likelihood combination of vision and touch for the height of a ridge, after
# Ernst & Banks (2002): standard 55 mm, haptic threshold ~0.085 x height, visual 0.04 x
# height at 0 % noise and 0.2 x at 200 %. Values at 67 % and 133 % are LINEAR
# INTERPOLATIONS (assumed, not reported). T = discrimination threshold (84 % point).
import math, random

def combine(tv, th):
    wv = th ** 2 / (tv ** 2 + th ** 2)
    return wv, math.sqrt(tv ** 2 * th ** 2 / (tv ** 2 + th ** 2))

if __name__ == "__main__":
    h = 55.0
    th = 0.085 * h
    noise = (0, 67, 133, 200)
    tvs = [h * (0.04 + 0.16 * n / 200) for n in noise]
    print(f"haptic threshold {th:.2f} mm")
    print("noise   T_V    w_V   T_VH   best single  felt height (V +3, H -3 mm)")
    for n, tv in zip(noise, tvs):
        wv, tvh = combine(tv, th)
        shift = (2 * wv - 1) * 6 / 2                          # visual +3, haptic -3
        print(f"{n:4d}% {tv:6.2f} {wv:6.2f} {tvh:6.2f} {min(tv, th):9.2f}"
              f" {shift:+20.2f} mm")
    rng = random.Random(2002)                                 # check by simulation
    tv = tvs[1]
    wv, tvh = combine(tv, th)
    est = [wv * rng.gauss(0, tv) + (1 - wv) * rng.gauss(0, th) for _ in range(200000)]
    sd = math.sqrt(sum(e * e for e in est) / len(est))
    print(f"simulated combined spread at 67 %: {sd:.2f} (formula {tvh:.2f})")
    print("three ways a perceiver might use two cues (no conflict), threshold in mm:")
    print("noise   optimal   touch only   alternate 50:50   fixed 50:50 average")
    for n, tv in zip(noise, tvs):
        alt = math.sqrt(0.5 * tv ** 2 + 0.5 * th ** 2)
        avg = math.sqrt(0.25 * tv ** 2 + 0.25 * th ** 2)
        print(f"{n:4d}% {combine(tv, th)[1]:9.2f} {th:12.2f} {alt:17.2f} {avg:15.2f}")

Single source and citation

Fan, Y. (2026). Psychophysics, the Weber-Fechner Law and Optimal Bayesian Multisensory Integration (Version 1.0.0), Chapter 3: Bayesian Optimal Multisensory Integration. 5D Library. https://doi.org/10.5281/zenodo.23788548

DOI: 10.5281/zenodo.23788548 · Read the monograph · 5DL-B-034 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026034,
  author    = {Fan, Yafu},
  title     = {Psychophysics, the Weber-Fechner Law and Optimal Bayesian Multisensory Integration},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.23788548},
  url       = {https://doi.org/10.5281/zenodo.23788548}
}

Other chapter answers in this book