Humans integrate visual and haptic information in a statistically optimal fashion

Ernst MO, Banks MS (2002)
Nature 415(6870): 429-433.

Journal Article | Published | English

No fulltext has been uploaded

Author
;
Abstract
When a person looks at an object while exploring it with their hand, vision and touch both provide information for estimating the properties of the object. Vision frequently dominates the integrated visual-haptic percept, for example when judging size, shape or position(1-3), but in some circumstances the percept is clearly affected by haptics(4-7). Here we propose that a general principle, which minimizes variance in the final estimate, determines the degree to which vision or haptics dominates. This principle is realized by using maximum-likelihood estimation(8-15) to combine the inputs. To investigate cue combination quantitatively, we first measured the variances associated with visual and haptic estimation of height. We then used these measurements to construct a maximum-likelihood integrator. This model behaved very similarly to humans in a visual-haptic task. Thus, the nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator. Visual dominance occurs when the variance associated with visual estimation is lower than that associated with haptic estimation.
Publishing Year
ISSN
PUB-ID

Cite this

Ernst MO, Banks MS. Humans integrate visual and haptic information in a statistically optimal fashion. Nature. 2002;415(6870):429-433.
Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429-433.
Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433.
Ernst, M.O., & Banks, M.S., 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), p 429-433.
M.O. Ernst and M.S. Banks, “Humans integrate visual and haptic information in a statistically optimal fashion”, Nature, vol. 415, 2002, pp. 429-433.
Ernst, M.O., Banks, M.S.: Humans integrate visual and haptic information in a statistically optimal fashion. Nature. 415, 429-433 (2002).
Ernst, Marc O., and Banks, MS. “Humans integrate visual and haptic information in a statistically optimal fashion”. Nature 415.6870 (2002): 429-433.
This data publication is cited in the following publications:
This publication cites the following data publications:

822 Citations in Europe PMC

Data provided by Europe PubMed Central.

Do adjustments in search behavior depend on the precision of spatial memory?
Pfuhl G, Barrera LB, Living M, Biegler R., Learn Behav 41(1), 2013
PMID: 22886715
Looking at the task in hand impairs motor learning.
Wilkie RM, Johnson RL, Culmer PR, Allen R, Mon-Williams M., J. Neurophysiol. 108(11), 2012
PMID: 22993255
Evidence for multisensory integration in the elicitation of prior entry by bimodal cues.
Barrett DJ, Krumbholz K., Exp Brain Res 222(1-2), 2012
PMID: 22975896
Self-consistent learning of the environment.
Kang K, Amari S., Neural Comput 24(12), 2012
PMID: 22970868
Effective integration of serially presented stochastic cues.
Juni MZ, Gureckis TM, Maloney LT., J Vis 12(8), 2012
PMID: 22911906
Characterising the experience of interaction: an evaluation of automotive rotary dials.
Wellings T, Pitts MJ, Williams MA., Ergonomics 55(11), 2012
PMID: 22897607
Attention in a bayesian framework.
Whiteley L, Sahani M., Front Hum Neurosci 6(), 2012
PMID: 22712010
Perceiving transformed movements when using tools.
Sutter C, Sulzenbruck S., Exp Brain Res 218(2), 2012
PMID: 22456942
A comprehensive model of audiovisual perception: both percept and temporal dynamics.
Besson P, Bourdin C, Bringoux L., PLoS ONE 6(8), 2011
PMID: 21887324
No transfer of calibration between action and perception in learning a golf putting task.
Van Lier W, Van der Kamp J, van der Zanden A, Savelsbergh GJ., Atten Percept Psychophys 73(7), 2011
PMID: 21814859
Perception of 3D Slant Out of the Box.
van der Kooij K, Te Pas SF., Front Psychol 2(), 2011
PMID: 21713121
Visual perception: bizarre contours go against the odds.
Fleming RW., Curr. Biol. 21(7), 2011
PMID: 21481763
Conjugate mixture models for clustering multimodal data.
Khalidov V, Forbes F, Horaud R., Neural Comput 23(2), 2011
PMID: 21105829
Contributions of category and fine-grained information to location memory: when categories don't weigh in.
Spetch ML, Friedman A, Bialowas J, Verbeek E., Mem Cognit 38(2), 2010
PMID: 20173188
Investigation of goal change to optimize upper-extremity motor performance in a robotic environment.
Brewer BR, Klatzky R, Markham H, Matsuoka Y., Dev Med Child Neurol 51 Suppl 4(), 2009
PMID: 19740223
Right way neurons.
Bennur S, Gold JI., Nat. Neurosci. 11(10), 2008
PMID: 18818590
The virtual haptic display: a device for exploring 2-D virtual shapes in the tactile modality.
Chan JS, Maucher T, Schemmel J, Kilroy D, Newell FN, Meier K., Behav Res Methods 39(4), 2007
PMID: 18183894
Feeling darkness: a visually induced somatosensory illusion.
Wolfe U, Comee JA, Sherman BS., Percept Psychophys 69(6), 2007
PMID: 18018968

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Sources

PMID: 11807554
PubMed | Europe PMC

Search this title in

Google Scholar