The combination of vision and touch depends on spatial proximity

Gepshtein S, Burge J, Ernst MO, Banks MS (2005)
Journal of Vision 5(11): 7.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Gepshtein, S; Burge, J; Ernst, Marc O.UniBi; Banks, MS
Abstract / Bemerkung
The nervous system often combines visual and haptic information about object properties such that the combined estimate is more precise than with vision or haptics alone. We examined how the system determines when to combine the signals. Presumably, signals should not be combined when they come from different objects. The likelihood that signals come from different objects is highly correlated with the spatial separation between the signals, so we asked how the spatial separation between visual and haptic signals affects their combination. To do this, we first created conditions for each observer in which the effect of combination-the increase in discrimination precision with two modalities relative to performance with one modality-should be maximal. Then under these conditions, we presented visual and haptic stimuli separated by different spatial distances and compared human performance with predictions of a model that combined signals optimally. We found that discrimination precision was essentially optimal when the signals came from the same location, and that discrimination precision was poorer when the signals came from different locations. Thus, the mechanism of visual-haptic combination is specialized for signals that coincide in space.
optimality; objects; vision; inter-sensory integration; haptics; multidimensional classification; proximity principle; spatial attention
Journal of Vision
Page URI


Gepshtein S, Burge J, Ernst MO, Banks MS. The combination of vision and touch depends on spatial proximity. Journal of Vision. 2005;5(11):7.
Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. Journal of Vision, 5(11), 7.
Gepshtein, S, Burge, J, Ernst, Marc O., and Banks, MS. 2005. “The combination of vision and touch depends on spatial proximity”. Journal of Vision 5 (11): 7.
Gepshtein, S., Burge, J., Ernst, M. O., and Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. Journal of Vision 5, 7.
Gepshtein, S., et al., 2005. The combination of vision and touch depends on spatial proximity. Journal of Vision, 5(11), p 7.
S. Gepshtein, et al., “The combination of vision and touch depends on spatial proximity”, Journal of Vision, vol. 5, 2005, pp. 7.
Gepshtein, S., Burge, J., Ernst, M.O., Banks, M.S.: The combination of vision and touch depends on spatial proximity. Journal of Vision. 5, 7 (2005).
Gepshtein, S, Burge, J, Ernst, Marc O., and Banks, MS. “The combination of vision and touch depends on spatial proximity”. Journal of Vision 5.11 (2005): 7.

56 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Grasping movements toward seen and handheld objects.
Camponogara I, Volcic R., Sci Rep 9(1), 2019
PMID: 30842478
Optimal integration of intraneural somatosensory feedback with visual information: a single-case study.
Risso G, Valle G, Iberite F, Strauss I, Stieglitz T, Controzzi M, Clemente F, Granata G, Rossini PM, Micera S, Baud-Bovy G., Sci Rep 9(1), 2019
PMID: 31133637
Object discrepancy modulates feature prediction across eye movements.
Köller CP, Poth CH, Herwig A., Psychol Res (), 2018
PMID: 29387939
Suboptimality in Perceptual Decision Making.
Rahnev D, Denison RN., Behav Brain Sci (), 2018
PMID: 29485020
Perceptual attraction in tool use: evidence for a reliability-based weighting mechanism.
Debats NB, Ernst MO, Heuer H., J Neurophysiol 117(4), 2017
PMID: 28100656
Optimal visual-haptic integration with articulated tools.
Takahashi C, Watt SJ., Exp Brain Res 235(5), 2017
PMID: 28214998
Trust in haptic assistance: weighting visual and haptic cues based on error history.
Gibo TL, Mugge W, Abbink DA., Exp Brain Res 235(8), 2017
PMID: 28534068
Finding Home: Landmark Ambiguity in Human Navigation.
Jetzschke S, Ernst MO, Froehlich J, Boeddeker N., Front Behav Neurosci 11(), 2017
PMID: 28769773
Kinematic cross-correlation induces sensory integration across separate objects.
Debats NB, Ernst MO, Heuer H., Eur J Neurosci 46(12), 2017
PMID: 29068094
Optimal visual-vestibular integration under conditions of conflicting intersensory motion profiles.
Butler JS, Campos JL, Bülthoff HH., Exp Brain Res 233(2), 2015
PMID: 25361642
Again, knowledge of common source fails to promote visual-haptic integration.
Misceo GF, Jackson SV, Perdue JR., Percept Mot Skills 118(1), 2014
PMID: 24724521
On the 'visual' in 'audio-visual integration': a hypothesis concerning visual pathways.
Jaekl P, Pérez-Bellido A, Soto-Faraco S., Exp Brain Res 232(6), 2014
PMID: 24699769
Multisensory integration in action control.
Sutter C, Drewing K, Müsseler J., Front Psychol 5(), 2014
PMID: 24959154
Visual and haptic integration in the estimation of softness of deformable objects.
Cellini C, Kaim L, Drewing K., Iperception 4(8), 2013
PMID: 25165510
Time gain influences adaptive visual-motor isometric force control.
Hu X, Mazich MM, Newell KM., Exp Brain Res 218(1), 2012
PMID: 22278109
Audiovisual time perception is spatially specific.
Heron J, Roach NW, Hanson JV, McGraw PV, Whitaker D., Exp Brain Res 218(3), 2012
PMID: 22367399
Multistability, cross-modal binding and the additivity of conjoined grouping principles.
Kubovy M, Yu M., Philos Trans R Soc Lond B Biol Sci 367(1591), 2012
PMID: 22371617
Continuous evolution of statistical estimators for optimal decision-making.
Saunders I, Vijayakumar S., PLoS One 7(6), 2012
PMID: 22761657
Cross-modal processing in the occipito-temporal cortex: a TMS study of the Müller-Lyer illusion.
Mancini F, Bolognini N, Bricolo E, Vallar G., J Cogn Neurosci 23(8), 2011
PMID: 20807050
Testing the limits of optimal integration of visual and proprioceptive information of path trajectory.
Reuschel J, Rösler F, Henriques DY, Fiehler K., Exp Brain Res 209(4), 2011
PMID: 21347659
Visual-haptic cue integration with spatial and temporal disparity during pointing movements.
Serwe S, Körding KP, Trommershäuser J., Exp Brain Res 210(1), 2011
PMID: 21374079
Multisensory integration in the Muller-Lyer illusion: from vision to haptics.
Mancini F, Bricolo E, Vallar G., Q J Exp Psychol (Hove) 63(4), 2010
PMID: 19728224
Optimal integration of visual and proprioceptive movement information for the perception of trajectory geometry.
Reuschel J, Drewing K, Henriques DY, Rösler F, Fiehler K., Exp Brain Res 201(4), 2010
PMID: 19953230
Encoding of tangential torque in responses of tactile afferent fibres innervating the fingerpad of the monkey.
Birznieks I, Wheat HE, Redmond SJ, Salo LM, Lovell NH, Goodwin AW., J Physiol 588(pt 7), 2010
PMID: 20142274
Visualizing 3D objects from 2D cross sectional images displayed in-situ versus ex-situ.
Wu B, Klatzky RL, Stetten G., J Exp Psychol Appl 16(1), 2010
PMID: 20350043
In praise of "false" models and rich data.
Fernandes HL, Kording KP., J Mot Behav 42(6), 2010
PMID: 21184351
Sensory dominance in combinations of audio, visual and haptic stimuli.
Hecht D, Reiner M., Exp Brain Res 193(2), 2009
PMID: 18985327
Relevance of error: what drives motor adaptation?
Wei K, Körding K., J Neurophysiol 101(2), 2009
PMID: 19019979
Testing a counter-intuitive prediction of optimal cue combination.
Muller CM, Brenner E, Smeets JB., Vision Res 49(1), 2009
PMID: 18983869
Multisensory oddity detection as bayesian inference.
Hospedales T, Vijayakumar S., PLoS One 4(1), 2009
PMID: 19145254
The role of visuohaptic experience in visually perceived depth.
Ho YX, Serwe S, Trommershäuser J, Maloney LT, Landy MS., J Neurophysiol 101(6), 2009
PMID: 19357346
Combining eye and hand in search is suboptimal.
Liesker H, Brenner E, Smeets JB., Exp Brain Res 197(4), 2009
PMID: 19590859
When vision 'extinguishes' touch in neurologically-normal people: extending the Colavita visual dominance effect.
Hartcher-O'Brien J, Gallace A, Krings B, Koppen C, Spence C., Exp Brain Res 186(4), 2008
PMID: 18301885
Material properties determine how force and position signals combine in haptic shape perception.
Drewing K, Wiecki TV, Ernst MO., Acta Psychol (Amst) 128(2), 2008
PMID: 18359467
Multisensory integration: a late bloomer.
Ernst MO., Curr Biol 18(12), 2008
PMID: 18579094
Knowledge about a common source can promote visual- haptic integration.
Helbig HB, Ernst MO., Perception 36(10), 2007
PMID: 18265835
Optimal integration of shape information from vision and touch.
Helbig HB, Ernst MO., Exp Brain Res 179(4), 2007
PMID: 17225091
Causal inference in multisensory perception.
Körding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L., PLoS One 2(9), 2007
PMID: 17895984

28 References

Daten bereitgestellt von Europe PubMed Central.

Bevington P, Robinson DK., 1992
Feeling what you hear: Auditory signals can modulate tactile taps perception
Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A., 2005

Coombs CH, Dawes RM, Tversky A., 1970

Duda RO, Hart PE, Stork DG., 2001
Edge co-occurrence in natural images predicts contour grouping performance.
Geisler WS, Perry JS, Super BJ, Gallogly DP., Vision Res. 41(6), 2001
PMID: 11248261
Combining sensory information: mandatory fusion within, but not between, senses.
Hillis JM, Ernst MO, Banks MS, Landy MS., Science 298(5598), 2002
PMID: 12446912

Kanizsa G., 1979

Krantz D, Luce R, Suppes P, Tversky A., 1971
On the lawfulness of grouping by proximity.
Kubovy M, Holcombe AO, Wagemans J., Cogn Psychol 35(1), 1998
PMID: 9520318
Measurement and modeling of depth cue combination: in defense of weak fusion.
Landy MS, Maloney LT, Johnston EB, Young M., Vision Res. 35(3), 1995
PMID: 7892735
A reply to McDonald, J. J., Teder-Sälejärvi, W. A., & Ward, L. M. Multisensory integration and crossmodal attention effects in the human brain
Macaluso E, Frith C, Driver J., 2001

Martin D, Fowlkes C, Tal D, Malik J., 0
The phenomenology of attention: Part 1. Color, location, orientation, and “clarity.”
Prinzmetal W, Amiri H, Allen K, Edwards T., 1998

Rosenblatt F., 1961
The binding problem.
Roskies AL., Neuron 24(1), 1999
PMID: 10677022
Statistics of natural images: Scaling in the woods.
Ruderman DL, Bialek W., Phys. Rev. Lett. 73(6), 1994
PMID: 10057546
Illusions. What you see is what you hear.
Shams L, Kamitani Y, Shimojo S., Nature 408(6814), 2000
PMID: 11130706
Exogenous spatial-cuing studies of human crossmodal attention and multisensory integration
Spence C, McDonald J, Driver J., 2004
Illusory conjunctions in the perception of objects.
Treisman A, Schmidt H., Cogn Psychol 14(1), 1982
PMID: 7053925
When feeling is more important than seeing in sensorimotor adaptation.
van Beers RJ, Wolpert DM, Haggard P., Curr. Biol. 12(10), 2002
PMID: 12015120
The what and why of binding: the modeler's perspective.
von der Malsburg C., Neuron 24(1), 1999
PMID: 10677030
Laws of organization in perceptual forms
Wertheimer M., 1936
Bayesian decision theory and psychophysics
Yuille AL, Bütlhoff HH., 1996

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

PMID: 16441199
PubMed | Europe PMC

Suchen in

Google Scholar