When correlation implies causation in multisensory integration

Parise C, Spence C, Ernst MO (2012)
Current Biology 22(1): 46-49.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Abstract / Bemerkung
Inferring which signals have a common underlying cause and hence should be integrated, represents a primary challenge for a perceptual system dealing with multiple sensory inputs [1-3]. This challenge is often referred to as the correspondence problem or causal inference. Previous research has demonstrated that spatiotemporal cues, along with prior knowledge, are exploited by the human brain to solve this problem [4-9]. Here we explore the role of correlation between the fine temporal structure of auditory and visual signals in causal inference. Specifically, we investigated whether correlated signals are inferred to originate from the same distal event and hence are integrated optimally [10]. In a localization task with visual, auditory, and combined audiovisual targets, the improvement in precision for combined relative to unimodal targets, was statistically optimal only when audiovisual signals were correlated. This result demonstrates that humans use the similarity in the temporal structure of multisensory signals to solve the correspondence problem, hence inferring causation from correlation.
Current Biology
Page URI


Parise C, Spence C, Ernst MO. When correlation implies causation in multisensory integration. Current Biology. 2012;22(1):46-49.
Parise, C., Spence, C., & Ernst, M. O. (2012). When correlation implies causation in multisensory integration. Current Biology, 22(1), 46-49. https://doi.org/10.1016/j.cub.2011.11.039
Parise, Cesare, Spence, Charles, and Ernst, Marc O. 2012. “When correlation implies causation in multisensory integration”. Current Biology 22 (1): 46-49.
Parise, C., Spence, C., and Ernst, M. O. (2012). When correlation implies causation in multisensory integration. Current Biology 22, 46-49.
Parise, C., Spence, C., & Ernst, M.O., 2012. When correlation implies causation in multisensory integration. Current Biology, 22(1), p 46-49.
C. Parise, C. Spence, and M.O. Ernst, “When correlation implies causation in multisensory integration”, Current Biology, vol. 22, 2012, pp. 46-49.
Parise, C., Spence, C., Ernst, M.O.: When correlation implies causation in multisensory integration. Current Biology. 22, 46-49 (2012).
Parise, Cesare, Spence, Charles, and Ernst, Marc O. “When correlation implies causation in multisensory integration”. Current Biology 22.1 (2012): 46-49.

63 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Decreased Temporal Sensorimotor Adaptation Due to Perturbation-Induced Measurement Noise.
Knelange EB, López-Moliner J., Front Hum Neurosci 13(), 2019
PMID: 30837854
Sensitivity to auditory-tactile colocation in early infancy.
Thomas RL, Misra R, Akkunt E, Ho C, Spence C, Bremner AJ., Dev Sci 21(4), 2018
PMID: 28880496
Attentional reorienting triggers spatial asymmetries in a search task with cross-modal spatial cueing.
Paladini RE, Diana L, Zito GA, Nyffeler T, Wyss P, Mosimann UP, Müri RM, Nef T, Cazzoli D., PLoS One 13(1), 2018
PMID: 29293637
Sound changes that lead to seeing longer-lasting shapes.
Samuel AG, Tangella K., Atten Percept Psychophys 80(4), 2018
PMID: 29380283
Audiovisual Temporal Perception in Aging: The Role of Multisensory Integration and Age-Related Sensory Loss.
Brooks CJ, Chan YM, Anderson AJ, McKendrick AM., Front Hum Neurosci 12(), 2018
PMID: 29867415
Temporal Reference, Attentional Modulation, and Crossmodal Assimilation.
Wan Y, Chen L., Front Comput Neurosci 12(), 2018
PMID: 29922143
Phasic and sustained interactions of multisensory interplay and temporal expectation.
Ball F, Fuehrmann F, Stratil F, Noesselt T., Sci Rep 8(1), 2018
PMID: 29976998
Auditory motion does not modulate spiking activity in the middle temporal and medial superior temporal visual areas.
Chaplin TA, Allitt BJ, Hagan MA, Rosa MGP, Rajan R, Lui LL., Eur J Neurosci 48(4), 2018
PMID: 30019438
Multisensory perception reflects individual differences in processing temporal correlations.
Nidiffer AR, Diederich A, Ramachandran R, Wallace MT., Sci Rep 8(1), 2018
PMID: 30262826
A causal inference explanation for enhancement of multisensory integration by co-articulation.
Magnotti JF, Smith KB, Salinas M, Mays J, Zhu LL, Beauchamp MS., Sci Rep 8(1), 2018
PMID: 30575791
Perceptual attraction in tool use: evidence for a reliability-based weighting mechanism.
Debats NB, Ernst MO, Heuer H., J Neurophysiol 117(4), 2017
PMID: 28100656
Optimal visual-haptic integration with articulated tools.
Takahashi C, Watt SJ., Exp Brain Res 235(5), 2017
PMID: 28214998
Topodynamics of metastable brains.
Tozzi A, Peters JF, Fingelkurts AA, Fingelkurts AA, Marijuán PC., Phys Life Rev 21(), 2017
PMID: 28372988
Bi-directional audiovisual influences on temporal modulation discrimination.
Varghese L, Mathias SR, Bensussen S, Chou K, Goldberg HR, Sun Y, Sekuler R, Shinn-Cunningham BG., J Acoust Soc Am 141(4), 2017
PMID: 28464677
A simple and efficient method to enhance audiovisual binding tendencies.
Odegaard B, Wozny DR, Shams L., PeerJ 5(), 2017
PMID: 28462016
Temporal causal inference with stochastic audiovisual sequences.
Locke SM, Landy MS., PLoS One 12(9), 2017
PMID: 28886035
The Prediction of Impact of a Looming Stimulus onto the Body Is Subserved by Multisensory Integration Mechanisms.
Cléry J, Guipponi O, Odouard S, Pinède S, Wardak C, Ben Hamed S., J Neurosci 37(44), 2017
PMID: 28993482
Kinematic cross-correlation induces sensory integration across separate objects.
Debats NB, Ernst MO, Heuer H., Eur J Neurosci 46(12), 2017
PMID: 29068094
The sense of body ownership relaxes temporal constraints for multisensory integration.
Maselli A, Kilteni K, López-Moliner J, Slater M., Sci Rep 6(), 2016
PMID: 27485049
Memory and learning with rapid audiovisual sequences.
Keller AS, Sekuler R., J Vis 15(15), 2015
PMID: 26575193
Perception of body ownership is driven by Bayesian sensory inference.
Samad M, Chung AJ, Shams L., PLoS One 10(2), 2015
PMID: 25658822
Coincidence avoidance principle in surface haptic interpretation.
Manuel SG, Klatzky RL, Peshkin MA, Colgate JE., Proc Natl Acad Sci U S A 112(8), 2015
PMID: 25675477
Impact prediction by looming visual stimuli enhances tactile detection.
Cléry J, Guipponi O, Odouard S, Wardak C, Ben Hamed S., J Neurosci 35(10), 2015
PMID: 25762665
Infants' preference for native audiovisual speech dissociated from congruency preference.
Shaw K, Baart M, Depowski N, Bortfeld H., PLoS One 10(4), 2015
PMID: 25927529
Policing Fish at Boston's Museum of Science: Studying Audiovisual Interaction in the Wild.
Goldberg H, Sun Y, Hickey TJ, Shinn-Cunningham B, Sekuler R., Iperception 6(4), 2015
PMID: 27433321
How to Get the Full Prism Effect.
Pochopien K, Fahle M., Iperception 6(4), 2015
PMID: 27433319
Biases in Visual, Auditory, and Audiovisual Perception of Space.
Odegaard B, Wozny DR, Shams L., PLoS Comput Biol 11(12), 2015
PMID: 26646312
Sources of Confusion in Infant Audiovisual Speech Perception Research.
Shaw KE, Bortfeld H., Front Psychol 6(), 2015
PMID: 26696919
Spatiotemporal Processing in Crossmodal Interactions for Perception of the External World: A Review.
Hidaka S, Teramoto W, Sugita Y., Front Integr Neurosci 9(), 2015
PMID: 26733827
Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants.
Baart M, Vroomen J, Shaw K, Bortfeld H., Cognition 130(1), 2014
PMID: 24141035
The Butcher's Tongue Illusion.
Michel C, Velasco C, Salgado-Montejo A, Spence C., Perception 43(8), 2014
PMID: 25549512
Developmental trends in the facilitation of multisensory objects with distractors.
Downing HC, Barutchu A, Crewther SG., Front Psychol 5(), 2014
PMID: 25653630
Again, knowledge of common source fails to promote visual-haptic integration.
Misceo GF, Jackson SV, Perdue JR., Percept Mot Skills 118(1), 2014
PMID: 24724521
Multisensory integration: flexible use of general operations.
van Atteveldt N, Murray MM, Thut G, Schroeder CE., Neuron 81(6), 2014
PMID: 24656248
The Marble-Hand Illusion.
Senna I, Maravita A, Bolognini N, Parise CV., PLoS One 9(3), 2014
PMID: 24621793
Multisensory constraints on awareness.
Deroy O, Chen YC, Spence C., Philos Trans R Soc Lond B Biol Sci 369(1641), 2014
PMID: 24639579
Temporal prediction errors in visual and auditory cortices.
Lee H, Noppeney U., Curr Biol 24(8), 2014
PMID: 24735850
Natural auditory scene statistics shapes human spatial hearing.
Parise CV, Knorre K, Ernst MO., Proc Natl Acad Sci U S A 111(16), 2014
PMID: 24711409
Vision of tongue movements bias auditory speech perception.
D'Ausilio A, Bartoli E, Maffongelli L, Berry JJ, Fadiga L., Neuropsychologia 63(), 2014
PMID: 25172391
Auditory coding of human movement kinematics.
Vinken PM, Kröger D, Fehse U, Schmitz G, Brock H, Effenberg AO., Multisens Res 26(6), 2013
PMID: 24800411
Temporal structure and complexity affect audio-visual correspondence detection.
Denison RN, Driver J, Ruff CC., Front Psychol 3(), 2012
PMID: 23346067
Self-motion leads to mandatory cue fusion across sensory modalities.
Prsa M, Gale S, Blanke O., J Neurophysiol 108(8), 2012
PMID: 22832567

20 References

Daten bereitgestellt von Europe PubMed Central.

Immediate perceptual response to intersensory discrepancy.
Welch RB, Warren DH., Psychol Bull 88(3), 1980
PMID: 7003641
Merging the senses into a robust percept.
Ernst MO, Bulthoff HH., Trends Cogn. Sci. (Regul. Ed.) 8(4), 2004
PMID: 15050512
Causal inference in perception.
Shams L, Beierholm UR., Trends Cogn. Sci. (Regul. Ed.) 14(9), 2010
PMID: 20705502
Feeling what you hear: auditory signals can modulate tactile tap perception.
Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A., Exp Brain Res 162(2), 2004
PMID: 15791465
The combination of vision and touch depends on spatial proximity
Gepshtein, J. Vis. 5(), 2005
Causal inference in multisensory perception.
Kording KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L., PLoS ONE 2(9), 2007
PMID: 17895984
Knowledge about a common source can promote visual- haptic integration.
Helbig HB, Ernst MO., Perception 36(10), 2007
PMID: 18265835
Auditory-visual interaction and the timing of inputs. Thomas (1941) revisited.
Radeau M, Bertelson P., Psychol Res 49(1), 1987
PMID: 3615744
Binocular cross-correlation in time and space.
Tyler CW., Vision Res. 18(1), 1978
PMID: 664265
Temporal mechanisms of multimodal binding.
Burr D, Silva O, Cicchini GM, Banks MS, Morrone MC., Proc. Biol. Sci. 276(1663), 2009
PMID: 19324779
Multimodal structure of the extrapersonal space
Grusser, 1983
Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets
Lewald, J. Acoust. Soc. Am. 104(), 1998

Knill, 1996

Blauert, 1997
Recalibration of audiovisual simultaneity.
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

PMID: 22177899
PubMed | Europe PMC

Suchen in

Google Scholar