What does Psychophysics and Multisensory Integration conclude, in numbers, about “Sensory Substitution and Cross-Modal Plasticity”?

Answer: The tactile vision-substitution device of Bach-y-Rita in 1969 stimulated the skin of the back; electrotactile arrays on the tongue came later; the auditory device vOICe codes height as pitch and brightness as loudness. The visual cortex of blind people can be activated by Braille reading and contributes functionally to tactile tasks, and a shape-processing region of the lateral occipital cortex can be activated by sound-coded shapes. With a substitution device, congenitally blind people can score better than the blindness line on an acuity chart, but only by narrowing the field and lengthening the scan. Active control of the camera matters for learning the mapping between action and sensation. All these studies are small, and claims of "really seeing" must be qualified. The next chapter turns to ancient texts on the senses.

Scope of the numbers: This book is not medical advice and cannot diagnose any sensory or neurological condition. Marked boxes separate published evidence, runnable Python calculations (17 programs, all checked), classical sources and the author's hypotheses.

中文版

Data table

The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it.

devicefieldpixel (arcmin)best 20/X: 1 px2 pxbeats 20/400?
vOICe 64 cols60.056.211252250no
vOICe 64 cols30.028.15621125no
vOICe 64 cols15.014.1281562only at 1 px
vOICe 64 cols7.57.0141281yes
tactile 20x2060.0180.036007200no
tactile 20x2030.090.018003600no
tactile 20x2015.045.09001800no
tactile 20x207.522.5450900no
field for 20/200 with 64 columns, 2 px per detail: 5.3 deg (11.2x zoom from 60 deg)
price of zoom: the 64 columns cover less of the scene, so finding an object
takes more head or camera movements and more 1-second scans
Show the full program
# The resolution budget of a sensory-substitution device. Snellen 20/X means the smallest
# resolvable detail (gap of a letter E) subtends X/20 arcmin. A device that samples the
# camera image with C columns over a horizontal field F deg has pixels of 60 F / C arcmin.
# Optimistic limit: detail = 1 pixel; realistic: 2 pixels (sampling). Devices: the vOICe
# (64 columns, Meijer 1992); a 20 x 20 tactile array (Bach-y-Rita et al. 1969).
WHO_BLIND = 400                                     # worse than 20/400: blindness (WHO)

def snellen(field_deg, columns, px_per_detail):
    return 20 * px_per_detail * 60 * field_deg / columns

if __name__ == "__main__":
    print("device          field  pixel (arcmin)  best 20/X: 1 px   2 px   beats 20/400?")
    for name, cols in (("vOICe 64 cols", 64), ("tactile 20x20", 20)):
        for field in (60, 30, 15, 7.5):
            x1, x2 = snellen(field, cols, 1), snellen(field, cols, 2)
            ok = "yes" if x2 < WHO_BLIND else ("only at 1 px" if x1 < WHO_BLIND else "no")
            print(f"{name:14s} {field:6.1f} {60 * field / cols:11.1f} {x1:15.0f}"
                  f" {x2:7.0f}   {ok}")
    need = 200 / 20 / 60 * 64 / 2                   # field: 20/200 at 2 px per detail
    print(f"field for 20/200 with 64 columns, 2 px per detail: {need:.1f} deg"
          f" ({60 / need:.1f}x zoom from 60 deg)")
    print("price of zoom: the 64 columns cover less of the scene, so finding an object")
    print("  takes more head or camera movements and more 1-second scans")

Single source and citation

Fan, Y. (2026). Psychophysics, the Weber-Fechner Law and Optimal Bayesian Multisensory Integration (Version 1.0.0), Chapter 6: Sensory Substitution and Cross-Modal Plasticity. 5D Library. https://doi.org/10.5281/zenodo.23788548

DOI: 10.5281/zenodo.23788548 · Read the monograph · 5DL-B-034 · v1.0.0 · CC-BY-NC-ND-4.0

BibTeX
@book{fan2026034,
  author    = {Fan, Yafu},
  title     = {Psychophysics, the Weber-Fechner Law and Optimal Bayesian Multisensory Integration},
  year      = {2026},
  publisher = {5D Library},
  edition   = {1.0.0},
  doi       = {10.5281/zenodo.23788548},
  url       = {https://doi.org/10.5281/zenodo.23788548}
}

Other chapter answers in this book