What does Psychophysics and Multisensory Integration conclude, in numbers, about “Sensory Substitution and Cross-Modal Plasticity”?
Answer: The tactile vision-substitution device of Bach-y-Rita in 1969 stimulated the skin of the back; electrotactile arrays on the tongue came later; the auditory device vOICe codes height as pitch and brightness as loudness. The visual cortex of blind people can be activated by Braille reading and contributes functionally to tactile tasks, and a shape-processing region of the lateral occipital cortex can be activated by sound-coded shapes. With a substitution device, congenitally blind people can score better than the blindness line on an acuity chart, but only by narrowing the field and lengthening the scan. Active control of the camera matters for learning the mapping between action and sensation. All these studies are small, and claims of "really seeing" must be qualified. The next chapter turns to ancient texts on the senses.
Scope of the numbers: This book is not medical advice and cannot diagnose any sensory or neurological condition. Marked boxes separate published evidence, runnable Python calculations (17 programs, all checked), classical sources and the author's hypotheses.
Data table
The numbers below are printed verbatim by the chapter's Python program and can be reproduced by running it.
| device | field | pixel (arcmin) | best 20/X: 1 px | 2 px | beats 20/400? |
| vOICe 64 cols | 60.0 | 56.2 | 1125 | 2250 | no |
| vOICe 64 cols | 30.0 | 28.1 | 562 | 1125 | no |
| vOICe 64 cols | 15.0 | 14.1 | 281 | 562 | only at 1 px |
| vOICe 64 cols | 7.5 | 7.0 | 141 | 281 | yes |
| tactile 20x20 | 60.0 | 180.0 | 3600 | 7200 | no |
| tactile 20x20 | 30.0 | 90.0 | 1800 | 3600 | no |
| tactile 20x20 | 15.0 | 45.0 | 900 | 1800 | no |
| tactile 20x20 | 7.5 | 22.5 | 450 | 900 | no |
| field for 20/200 with 64 columns, 2 px per detail: 5.3 deg (11.2x zoom from 60 deg) | |||||
| price of zoom: the 64 columns cover less of the scene, so finding an object | |||||
| takes more head or camera movements and more 1-second scans |
Show the full program
# The resolution budget of a sensory-substitution device. Snellen 20/X means the smallest
# resolvable detail (gap of a letter E) subtends X/20 arcmin. A device that samples the
# camera image with C columns over a horizontal field F deg has pixels of 60 F / C arcmin.
# Optimistic limit: detail = 1 pixel; realistic: 2 pixels (sampling). Devices: the vOICe
# (64 columns, Meijer 1992); a 20 x 20 tactile array (Bach-y-Rita et al. 1969).
WHO_BLIND = 400 # worse than 20/400: blindness (WHO)
def snellen(field_deg, columns, px_per_detail):
return 20 * px_per_detail * 60 * field_deg / columns
if __name__ == "__main__":
print("device field pixel (arcmin) best 20/X: 1 px 2 px beats 20/400?")
for name, cols in (("vOICe 64 cols", 64), ("tactile 20x20", 20)):
for field in (60, 30, 15, 7.5):
x1, x2 = snellen(field, cols, 1), snellen(field, cols, 2)
ok = "yes" if x2 < WHO_BLIND else ("only at 1 px" if x1 < WHO_BLIND else "no")
print(f"{name:14s} {field:6.1f} {60 * field / cols:11.1f} {x1:15.0f}"
f" {x2:7.0f} {ok}")
need = 200 / 20 / 60 * 64 / 2 # field: 20/200 at 2 px per detail
print(f"field for 20/200 with 64 columns, 2 px per detail: {need:.1f} deg"
f" ({60 / need:.1f}x zoom from 60 deg)")
print("price of zoom: the 64 columns cover less of the scene, so finding an object")
print(" takes more head or camera movements and more 1-second scans")Single source and citation
Fan, Y. (2026). Psychophysics, the Weber-Fechner Law and Optimal Bayesian Multisensory Integration (Version 1.0.0), Chapter 6: Sensory Substitution and Cross-Modal Plasticity. 5D Library. https://doi.org/10.5281/zenodo.23788548
DOI: 10.5281/zenodo.23788548 · Read the monograph · 5DL-B-034 · v1.0.0 · CC-BY-NC-ND-4.0
BibTeX
@book{fan2026034,
author = {Fan, Yafu},
title = {Psychophysics, the Weber-Fechner Law and Optimal Bayesian Multisensory Integration},
year = {2026},
publisher = {5D Library},
edition = {1.0.0},
doi = {10.5281/zenodo.23788548},
url = {https://doi.org/10.5281/zenodo.23788548}
}Other chapter answers in this book
- Chapter 1 · A Logarithmic Bridge between the Physical and the Subjective: Weber's Law and Fechner's Law
- Chapter 2 · Stevens's Power Law and Cross-Modality Matching
- Chapter 3 · Bayesian Optimal Multisensory Integration
- Chapter 4 · Causal Inference and the McGurk Effect
- Chapter 5 · Multisensory Neurons in the Superior Colliculus: Superadditivity and Inverse Effectiveness
- Chapter 8 · Practice and a Pre-Registered Trial