Combining sensory information: Mandatory fusion within, but not between, senses

Hillis JM, Ernst MO, Banks MS, Landy MS (2002)
Science 298(5598): 1627-1630.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Hillis, JM; Ernst, Marc O.UniBi; Banks, MS; Landy, MS
Abstract / Bemerkung
Humans use multiple sources of sensory information to estimate environmental properties. For example, the eyes and hands both provide relevant information about an object's shape. The eyes estimate shape using binocular disparity, perspective projection, etc. The hands supply haptic shape information by means of tactile and proprioceptive cues. Combining information across cues can improve estimation of object properties but may come at a cost: loss of single-cue information. We report that single-cue information is indeed lost when cues from within the same sensory modality (disparity and texture gradients in vision) are combined, but not when different modalities (vision and haptics) are combined.
Page URI


Hillis JM, Ernst MO, Banks MS, Landy MS. Combining sensory information: Mandatory fusion within, but not between, senses. Science. 2002;298(5598):1627-1630.
Hillis, J. M., Ernst, M. O., Banks, M. S., & Landy, M. S. (2002). Combining sensory information: Mandatory fusion within, but not between, senses. Science, 298(5598), 1627-1630.
Hillis, JM, Ernst, Marc O., Banks, MS, and Landy, MS. 2002. “Combining sensory information: Mandatory fusion within, but not between, senses”. Science 298 (5598): 1627-1630.
Hillis, J. M., Ernst, M. O., Banks, M. S., and Landy, M. S. (2002). Combining sensory information: Mandatory fusion within, but not between, senses. Science 298, 1627-1630.
Hillis, J.M., et al., 2002. Combining sensory information: Mandatory fusion within, but not between, senses. Science, 298(5598), p 1627-1630.
J.M. Hillis, et al., “Combining sensory information: Mandatory fusion within, but not between, senses”, Science, vol. 298, 2002, pp. 1627-1630.
Hillis, J.M., Ernst, M.O., Banks, M.S., Landy, M.S.: Combining sensory information: Mandatory fusion within, but not between, senses. Science. 298, 1627-1630 (2002).
Hillis, JM, Ernst, Marc O., Banks, MS, and Landy, MS. “Combining sensory information: Mandatory fusion within, but not between, senses”. Science 298.5598 (2002): 1627-1630.

152 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Suboptimal human multisensory cue combination.
Arnold DH, Petrie K, Murray C, Johnston A., Sci Rep 9(1), 2019
PMID: 30914673
An Artificial Flexible Visual Memory System Based on an UV-Motivated Memristor.
Chen S, Lou Z, Chen D, Shen G., Adv Mater 30(7), 2018
PMID: 29315837
Modeling auditory-visual evoked eye-head gaze shifts in dynamic multisteps.
Kasap B, van Opstal AJ., J Neurophysiol 119(5), 2018
PMID: 29384452
Suboptimality in Perceptual Decision Making.
Rahnev D, Denison RN., Behav Brain Sci (), 2018
PMID: 29485020
Integration of speed and time for estimating time to contact.
Chang CJ, Jazayeri M., Proc Natl Acad Sci U S A 115(12), 2018
PMID: 29507200
Causal Inference in the Perception of Verticality.
de Winkel KN, Katliar M, Diers D, Bülthoff HH., Sci Rep 8(1), 2018
PMID: 29615728
Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception.
Acerbi L, Dokka K, Angelaki DE, Ma WJ., PLoS Comput Biol 14(7), 2018
PMID: 30052625
Accuracy-Precision Trade-off in Human Sound Localisation.
Ege R, Opstal AJV, Van Wanrooij MM., Sci Rep 8(1), 2018
PMID: 30401920
Evolution of correlated complexity in the radically different courtship signals of birds-of-paradise.
Ligon RA, Diaz CD, Morano JL, Troscianko J, Stevens M, Moskeland A, Laman TG, Scholes E., PLoS Biol 16(11), 2018
PMID: 30457985
Touch Accelerates Visual Awareness.
Lunghi C, Lo Verde L, Alais D., Iperception 8(1), 2017
PMID: 28210486
Perceptual attraction in tool use: evidence for a reliability-based weighting mechanism.
Debats NB, Ernst MO, Heuer H., J Neurophysiol 117(4), 2017
PMID: 28100656
Perceptual precision of passive body tilt is consistent with statistically optimal cue integration.
Lim K, Karmali F, Nicoucar K, Merfeld DM., J Neurophysiol 117(5), 2017
PMID: 28179477
Binaural pitch fusion: Comparison of normal-hearing and hearing-impaired listeners.
Reiss LA, Shayman CS, Walker EP, Bennett KO, Fowler JR, Hartling CL, Glickman B, Lasarev MR, Oh Y., J Acoust Soc Am 141(3), 2017
PMID: 28372056
Illusory visual-depth reversal can modulate sensations of contact surface.
Igarashi Y, Omori K, Arai T, Aizawa Y., Exp Brain Res 235(10), 2017
PMID: 28721518
Sensory cue-combination in the context of newly learned categories.
Bankieris KR, Bejjanki VR, Aslin RN., Sci Rep 7(1), 2017
PMID: 28883455
Kinematic cross-correlation induces sensory integration across separate objects.
Debats NB, Ernst MO, Heuer H., Eur J Neurosci 46(12), 2017
PMID: 29068094
Flexible integration of visual cues in adolescents with autism spectrum disorder.
Bedford R, Pellicano E, Mareschal D, Nardini M., Autism Res 9(2), 2016
PMID: 26097109
Decentralized Multisensory Information Integration in Neural Systems.
Zhang WH, Chen A, Rasch MJ, Wu S., J Neurosci 36(2), 2016
PMID: 26758843
The Complex Interplay Between Multisensory Integration and Perceptual Awareness.
Deroy O, Faivre N, Lunghi C, Spence C, Aller M, Noppeney U., Multisens Res 29(6-7), 2016
PMID: 27795942
Confidence as a Common Currency between Vision and Audition.
de Gardelle V, Le Corre F, Mamassian P., PLoS One 11(1), 2016
PMID: 26808061
The diversity rank-score function for combining human visual perception systems.
Schweikert C, Mulia D, Sanchez K, Hsu DF., Brain Inform 3(1), 2016
PMID: 27747600
Interval timing, temporal averaging, and cue integration.
De Corte BJ, Matell MS., Curr Opin Behav Sci 8(), 2016
PMID: 27175440
Perceptual drifts of real and artificial limbs in the rubber hand illusion.
Fuchs X, Riemer M, Diers M, Flor H, Trojan J., Sci Rep 6(), 2016
PMID: 27103059
Dual-process theories and consciousness: the case for 'Type Zero' cognition.
Shea N, Frith CD., Neurosci Conscious 2016(1), 2016
PMID: 30109126
Presaccadic motion integration between current and future retinotopic locations of attended objects.
Szinte M, Jonikaitis D, Rolfs M, Cavanagh P, Deubel H., J Neurophysiol 116(4), 2016
PMID: 27385792
Estimating 3D tilt from local image cues in natural scenes.
Burge J, McCann BC, Geisler WS., J Vis 16(13), 2016
PMID: 27738702
Haptic adaptation to slant: No transfer between exploration modes.
van Dam LC, Plaisier MA, Glowania C, Ernst MO., Sci Rep 6(), 2016
PMID: 27698392
Optimal visual-vestibular integration under conditions of conflicting intersensory motion profiles.
Butler JS, Campos JL, Bülthoff HH., Exp Brain Res 233(2), 2015
PMID: 25361642
The oblique effect is both allocentric and egocentric.
Mikellidou K, Cicchini GM, Thompson PG, Burr DC., J Vis 15(8), 2015
PMID: 26129862
On the combination of two visual cognition systems using combinatorial fusion.
Batallones A, Sanchez K, Mott B, Coffran C, Frank Hsu D., Brain Inform 2(1), 2015
PMID: 27747501
Integration trumps selection in object recognition.
Saarela TP, Landy MS., Curr Biol 25(7), 2015
PMID: 25802154
Multisensory interactions between vestibular, visual and somatosensory signals.
Ferrè ER, Walther LE, Haggard P., PLoS One 10(4), 2015
PMID: 25875819
Dissecting neural circuits for multisensory integration and crossmodal processing.
Yau JM, DeAngelis GC, Angelaki DE., Philos Trans R Soc Lond B Biol Sci 370(1677), 2015
PMID: 26240418
Sensory development: late integration of multiple cues.
Mamassian P., Curr Biol 25(21), 2015
PMID: 26528747
Motor planning poststroke: impairment in vector-coded reach plans.
Rizzo JR, Hudson TE, Abdou A, Rashbaum IG, George AE, Raghavan P, Landy MS., Physiol Rep 3(12), 2015
PMID: 26660558
Neural coding of uncertainty and probability.
Ma WJ, Jazayeri M., Annu Rev Neurosci 37(), 2014
PMID: 25032495
Abnormal binaural spectral integration in cochlear implant users.
Reiss LA, Ito RA, Eggleston JL, Wozny DR., J Assoc Res Otolaryngol 15(2), 2014
PMID: 24464088
Does confidence use a common currency across two visual tasks?
de Gardelle V, Mamassian P., Psychol Sci 25(6), 2014
PMID: 24699845
Moving in time: Bayesian causal inference explains movement coordination to auditory beats.
Elliott MT, Wing AM, Welchman AE., Proc Biol Sci 281(1786), 2014
PMID: 24850915
The human somatosensory system: from perception to decision making.
Pleger B, Villringer A., Prog Neurobiol 103(), 2013
PMID: 23123624
Impact of the spatial congruence of redundant targets on within-modal and cross-modal integration.
Girard S, Pelland M, Lepore F, Collignon O., Exp Brain Res 224(2), 2013
PMID: 23183636
Cue integration and the perception of action in intentional binding.
Wolpe N, Haggard P, Siebner HR, Rowe JB., Exp Brain Res 229(3), 2013
PMID: 23371752
Integration of texture and disparity cues to surface slant in dorsal visual cortex.
Murphy AP, Ban H, Welchman AE., J Neurophysiol 110(1), 2013
PMID: 23576705
The role of binocular disparity in rapid scene and pattern recognition.
Valsecchi M, Caziot B, Backus BT, Gegenfurtner KR., Iperception 4(2), 2013
PMID: 23755357
Perceptual integration for qualitatively different 3-D cues in the human brain.
Dövencioğlu D, Ban H, Schofield AJ, Welchman AE., J Cogn Neurosci 25(9), 2013
PMID: 23647559
Dynamic weighting of multisensory stimuli shapes decision-making in rats and humans.
Sheppard JP, Raposo D, Churchland AK., J Vis 13(6), 2013
PMID: 23658374
A functional and perceptual signature of the second visual area in primates.
Freeman J, Ziemba CM, Heeger DJ, Simoncelli EP, Movshon JA., Nat Neurosci 16(7), 2013
PMID: 23685719
Brain responses to audiovisual speech mismatch in infants are associated with individual differences in looking behaviour.
Kushnerenko E, Tomalski P, Ballieux H, Ribeiro H, Potton A, Axelsson EL, Murphy E, Moore DG., Eur J Neurosci 38(9), 2013
PMID: 23889202
Depth and luminance edges attract.
Robinson AE, MacLeod DI., J Vis 13(11), 2013
PMID: 24013865
Observation of own exploration movements impairs haptic spatial perception.
Mueller S, Habermann S, Dudda J, Grunwald M., Exp Brain Res 231(4), 2013
PMID: 24071924
Kalman filtering naturally accounts for visually guided and predictive smooth pursuit dynamics.
Orban de Xivry JJ, Coppe S, Blohm G, Lefèvre P., J Neurosci 33(44), 2013
PMID: 24174663
Is one enough? The case for non-additive influences of visual features on crossmodal Stroop interference.
Appelbaum LG, Donohue SE, Park CJ, Woldorff MG., Front Psychol 4(), 2013
PMID: 24198800
Supervised calibration relies on the multisensory percept.
Zaidel A, Ma WJ, Angelaki DE., Neuron 80(6), 2013
PMID: 24290205
Steady-state responses in MEG demonstrate information integration within but not across the auditory and visual senses.
Giani AS, Ortiz E, Belardinelli P, Kleiner M, Preissl H, Noppeney U., Neuroimage 60(2), 2012
PMID: 22305992
The integration of motion and disparity cues to depth in dorsal visual cortex.
Ban H, Preston TJ, Meeson A, Welchman AE., Nat Neurosci 15(4), 2012
PMID: 22327475
Combination of texture and color cues in visual segmentation.
Saarela TP, Landy MS., Vision Res 58(), 2012
PMID: 22387319
Orchestrating the score: complex multimodal courtship in the Habronattus coecatus group of Habronattus jumping spiders (Araneae: Salticidae)
PMID: IND44768737
The perception of a face is no more than the sum of its parts.
Gold JM, Mundy PJ, Tjan BS., Psychol Sci 23(4), 2012
PMID: 22395131
Stereoscopy and the Human Visual System.
Banks MS, Read JC, Allison RS, Watt SJ., SMPTE Motion Imaging J 121(4), 2012
PMID: 23144596
Noise and correlations in parallel perceptual decision making.
Otto TU, Mamassian P., Curr Biol 22(15), 2012
PMID: 22771043
Self-motion leads to mandatory cue fusion across sensory modalities.
Prsa M, Gale S, Blanke O., J Neurophysiol 108(8), 2012
PMID: 22832567
Looking at the task in hand impairs motor learning.
Wilkie RM, Johnson RL, Culmer PR, Allen R, Mon-Williams M., J Neurophysiol 108(11), 2012
PMID: 22993255
Learning from vision-to-touch is different than learning from touch-to-vision.
Wismeijer DA, Gegenfurtner KR, Drewing K., Front Integr Neurosci 6(), 2012
PMID: 23181012
How little do we need for 3-D shape perception?
Nandakumar C, Torralba A, Malik J., Perception 40(3), 2011
PMID: 21692418
Performance in haptic geometrical matching tasks depends on movement and position of the arms.
Fernández-Díaz M, Travieso D., Acta Psychol (Amst) 136(3), 2011
PMID: 21295763
Bayesian approaches to sensory integration for motor control.
Berniker M, Kording K., Wiley Interdiscip Rev Cogn Sci 2(4), 2011
PMID: 26302201
Visual-haptic cue integration with spatial and temporal disparity during pointing movements.
Serwe S, Körding KP, Trommershäuser J., Exp Brain Res 210(1), 2011
PMID: 21374079
Visual perception: bizarre contours go against the odds.
Fleming RW., Curr Biol 21(7), 2011
PMID: 21481763
Differential integration of visual and kinaesthetic signals to upright stance.
Isableu B, Fourre B, Vuillerme N, Giraudet G, Amorim MA., Exp Brain Res 212(1), 2011
PMID: 21533556
Cue integration in categorical tasks: insights from audio-visual speech perception.
Bejjanki VR, Clayards M, Knill DC, Aslin RN., PLoS One 6(5), 2011
PMID: 21637344
Vision, haptics, and attention: new data from a multisensory Necker cube.
Bertamini M, Masala L, Meyer G, Bruno N., Perception 39(2), 2010
PMID: 20402242
Cue combination for 3D location judgements.
Svarverud E, Gilson SJ, Glennerster A., J Vis 10(1), 2010
PMID: 20143898
Touch disambiguates rivalrous perception at early stages of visual analysis.
Lunghi C, Binda P, Morrone MC., Curr Biol 20(4), 2010
PMID: 20178754
Sensor fusion in identified visual interneurons.
Parsons MM, Krapp HG, Laughlin SB., Curr Biol 20(7), 2010
PMID: 20303270
Audio-visual speech cue combination.
Arnold DH, Tear M, Schindel R, Roseboom W., PLoS One 5(4), 2010
PMID: 20419130
Acquired prior knowledge modulates audiovisual integration.
Van Wanrooij MM, Bremen P, John Van Opstal A., Eur J Neurosci 31(10), 2010
PMID: 20584180
The optimal time window of visual-auditory integration: a reaction time analysis.
Colonius H, Diederich A., Front Integr Neurosci 4(), 2010
PMID: 20485476
Discrimination contours for the perception of head-centered velocity.
Champion RA, Freeman TC., J Vis 10(6), 2010
PMID: 20884563
Individual differences in the ability to identify, select and use appropriate frames of reference for perceptuo-motor control.
Isableu B, Ohlmann T, Cremieux J, Vuillerme N, Amblard B, Gresty MA., Neuroscience 169(3), 2010
PMID: 20570716
Fusion of visual cues is not mandatory in children.
Nardini M, Bedford R, Mareschal D., Proc Natl Acad Sci U S A 107(39), 2010
PMID: 20837526
Rapid efficient coding of correlated complex acoustic properties.
Stilp CE, Rogers TT, Kluender KR., Proc Natl Acad Sci U S A 107(50), 2010
PMID: 21098293
Relevance of error: what drives motor adaptation?
Wei K, Körding K., J Neurophysiol 101(2), 2009
PMID: 19019979
Feeling pain in the rubber hand: integration of visual, proprioceptive, and painful stimuli.
Capelari ED, Uribe C, Brasil-Neto JP., Perception 38(1), 2009
PMID: 19323139
Multisensory oddity detection as bayesian inference.
Hospedales T, Vijayakumar S., PLoS One 4(1), 2009
PMID: 19145254
Representation recovers information.
Thornton C., Cogn Sci 33(8), 2009
PMID: 21585510
The statistical determinants of adaptation rate in human reaching.
Burge J, Ernst MO, Banks MS., J Vis 8(4), 2008
PMID: 18484859
Multisensory integration: a late bloomer.
Ernst MO., Curr Biol 18(12), 2008
PMID: 18579094
Vision merges with touch in a purely tactile discrimination.
Arabzadeh E, Clifford CW, Harris JA., Psychol Sci 19(7), 2008
PMID: 18727775
A visual-haptic Necker cube reveals temporal constraints on intersensory merging during perceptual exploration.
Bruno N, Jacomuzzi A, Bertamini M, Meyer G., Neuropsychologia 45(3), 2007
PMID: 16527315
A Bayesian model of the disambiguation of gravitoinertial force by visual cues.
MacNeilage PR, Banks MS, Berger DR, Bülthoff HH., Exp Brain Res 179(2), 2007
PMID: 17136526
Bayesian processing of vestibular information.
Laurens J, Droulez J., Biol Cybern 96(4), 2007
PMID: 17146661
Fast population coding.
Huys QJ, Zemel RS, Natarajan R, Dayan P., Neural Comput 19(2), 2007
PMID: 17206870
Robustness and complexity co-constructed in multimodal signalling networks.
Ay N, Flack J, Krakauer DC., Philos Trans R Soc Lond B Biol Sci 362(1479), 2007
PMID: 17255020
Judging surface slant for placing objects: a role for motion parallax.
Louw S, Smeets JB, Brenner E., Exp Brain Res 183(2), 2007
PMID: 17632707
How the parallel channels of the retina contribute to depth processing.
Schiller PH, Slocum WM, Weiner VS., Eur J Neurosci 26(5), 2007
PMID: 17767508
Integration of sensory evidence in motion discrimination.
Jazayeri M, Movshon JA., J Vis 7(12), 2007
PMID: 17997649
The effect of visual reliability on auditory-visual integration: an event-related potential study.
Liu Q, Qiu J, Chen A, Yang J, Zhang Q, Sun HJ., Neuroreport 18(17), 2007
PMID: 18090327
Noise characteristics and prior expectations in human visual speed perception.
Stocker AA, Simoncelli EP., Nat Neurosci 9(4), 2006
PMID: 16547513
The subjective visual vertical and the perceptual upright.
Dyde RT, Jenkin MR, Harris LR., Exp Brain Res 173(4), 2006
PMID: 16550392
The contribution of monocular depth cues to scene perception by pigeons.
Cavoto BR, Cook RG., Psychol Sci 17(7), 2006
PMID: 16866750
The detection of multisensory stimuli in an orthogonal sensory space.
Schnupp JW, Dawe KL, Pollack GL., Exp Brain Res 162(2), 2005
PMID: 15599727
3D shape perception from combined depth cues in human visual cortex.
Welchman AE, Deubelius A, Conrad V, Bülthoff HH, Kourtzi Z., Nat Neurosci 8(6), 2005
PMID: 15864303
The role of speed lines in subtle direction judgments.
Matthews N, Allen J., Vision Res 45(12), 2005
PMID: 15781078
"Phase capture" in amblyopia: the influence function for sampled shape.
Levi DM, Li RW, Klein SA., Vision Res 45(14), 2005
PMID: 15797769
Integrating visual cues for motor control: a matter of time.
Greenwald HS, Knill DC, Saunders JA., Vision Res 45(15), 2005
PMID: 15820516
The role of visual and nonvisual information in the control of locomotion.
Wilkie RM, Wann JP., J Exp Psychol Hum Percept Perform 31(5), 2005
PMID: 16262487
The combination of vision and touch depends on spatial proximity.
Gepshtein S, Burge J, Ernst MO, Banks MS., J Vis 5(11), 2005
PMID: 16441199
Bayesian integration in sensorimotor learning.
Körding KP, Wolpert DM., Nature 427(6971), 2004
PMID: 14724638
Object perception as Bayesian inference.
Kersten D, Mamassian P, Yuille A., Annu Rev Psychol 55(), 2004
PMID: 14744217
Combining cues while avoiding perceptual conflicts.
Hogervorst MA, Brenner E., Perception 33(10), 2004
PMID: 15693662
Neuroscience: what you see and hear is what you get.
Banks MS., Curr Biol 14(6), 2004
PMID: 15043834
No direction-specific bimodal facilitation for audiovisual motion detection.
Alais D, Burr D., Brain Res Cogn Brain Res 19(2), 2004
PMID: 15019714
Merging the senses into a robust percept.
Ernst MO, Bülthoff HH., Trends Cogn Sci 8(4), 2004
PMID: 15050512
Synaptic interactions between thalamic and cortical inputs onto cortical neurons in vivo.
Fuentealba P, Crochet S, Timofeev I, Steriade M., J Neurophysiol 91(5), 2004
PMID: 15069096
Task requirements influence sensory integration during grasping in humans.
Säfström D, Edin BB., Learn Mem 11(3), 2004
PMID: 15169866
Perceiving object motion using vision and touch.
James TW, Blake R., Cogn Affect Behav Neurosci 4(2), 2004
PMID: 15460926
Bayesian integration in force estimation.
Körding KP, Ku SP, Wolpert DM., J Neurophysiol 92(5), 2004
PMID: 15190091
Combining cues in contour orientation discrimination.
Popple AV, Levi DM., Vision Res 44(26), 2004
PMID: 15474581
Weighted linear cue combination with possibly correlated error.
Oruç I, Maloney LT, Landy MS., Vision Res 43(23), 2003
PMID: 12972395

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

PMID: 12446912
PubMed | Europe PMC

Suchen in

Google Scholar