When correlation implies causation in multisensory integration

Parise C, Spence C, Ernst MO (2012)
Current Biology 22(1): 46-49.

No fulltext has been uploaded. References only!
Journal Article | Original Article | Published | English

No fulltext has been uploaded

Inferring which signals have a common underlying cause and hence should be integrated, represents a primary challenge for a perceptual system dealing with multiple sensory inputs [1-3]. This challenge is often referred to as the correspondence problem or causal inference. Previous research has demonstrated that spatiotemporal cues, along with prior knowledge, are exploited by the human brain to solve this problem [4-9]. Here we explore the role of correlation between the fine temporal structure of auditory and visual signals in causal inference. Specifically, we investigated whether correlated signals are inferred to originate from the same distal event and hence are integrated optimally [10]. In a localization task with visual, auditory, and combined audiovisual targets, the improvement in precision for combined relative to unimodal targets, was statistically optimal only when audiovisual signals were correlated. This result demonstrates that humans use the similarity in the temporal structure of multisensory signals to solve the correspondence problem, hence inferring causation from correlation.
Publishing Year

Cite this

Parise C, Spence C, Ernst MO. When correlation implies causation in multisensory integration. Current Biology. 2012;22(1):46-49.
Parise, C., Spence, C., & Ernst, M. O. (2012). When correlation implies causation in multisensory integration. Current Biology, 22(1), 46-49. doi:10.1016/j.cub.2011.11.039
Parise, C., Spence, C., and Ernst, M. O. (2012). When correlation implies causation in multisensory integration. Current Biology 22, 46-49.
Parise, C., Spence, C., & Ernst, M.O., 2012. When correlation implies causation in multisensory integration. Current Biology, 22(1), p 46-49.
C. Parise, C. Spence, and M.O. Ernst, “When correlation implies causation in multisensory integration”, Current Biology, vol. 22, 2012, pp. 46-49.
Parise, C., Spence, C., Ernst, M.O.: When correlation implies causation in multisensory integration. Current Biology. 22, 46-49 (2012).
Parise, Cesare, Spence, Charles, and Ernst, Marc O. “When correlation implies causation in multisensory integration”. Current Biology 22.1 (2012): 46-49.
This data publication is cited in the following publications:
This publication cites the following data publications:

25 Citations in Europe PMC

Data provided by Europe PubMed Central.

Spatiotemporal Processing in Crossmodal Interactions for Perception of the External World: A Review.
Hidaka S, Teramoto W, Sugita Y., Front Integr Neurosci 9(), 2015
PMID: 26733827
Sources of Confusion in Infant Audiovisual Speech Perception Research.
Shaw KE, Bortfeld H., Front Psychol 6(), 2015
PMID: 26696919
Biases in Visual, Auditory, and Audiovisual Perception of Space.
Odegaard B, Wozny DR, Shams L., PLoS Comput. Biol. 11(12), 2015
PMID: 26646312
Memory and learning with rapid audiovisual sequences.
Keller AS, Sekuler R., J Vis 15(15), 2015
PMID: 26575193
Infants' preference for native audiovisual speech dissociated from congruency preference.
Shaw K, Baart M, Depowski N, Bortfeld H., PLoS ONE 10(4), 2015
PMID: 25927529
Coincidence avoidance principle in surface haptic interpretation.
Manuel SG, Klatzky RL, Peshkin MA, Colgate JE., Proc. Natl. Acad. Sci. U.S.A. 112(8), 2015
PMID: 25675477
Perception of body ownership is driven by Bayesian sensory inference.
Samad M, Chung AJ, Shams L., PLoS ONE 10(2), 2015
PMID: 25658822
Developmental trends in the facilitation of multisensory objects with distractors.
Downing HC, Barutchu A, Crewther SG., Front Psychol 5(), 2014
PMID: 25653630
Vision of tongue movements bias auditory speech perception.
D'Ausilio A, Bartoli E, Maffongelli L, Berry JJ, Fadiga L., Neuropsychologia 63(), 2014
PMID: 25172391
Temporal prediction errors in visual and auditory cortices.
Lee H, Noppeney U., Curr. Biol. 24(8), 2014
PMID: 24735850
Again, knowledge of common source fails to promote visual-haptic integration.
Misceo GF, Jackson SV, Perdue JR., Percept Mot Skills 118(1), 2014
PMID: 24724521
Natural auditory scene statistics shapes human spatial hearing.
Parise CV, Knorre K, Ernst MO., Proc. Natl. Acad. Sci. U.S.A. 111(16), 2014
PMID: 24711409
Multisensory integration: flexible use of general operations.
van Atteveldt N, Murray MM, Thut G, Schroeder CE., Neuron 81(6), 2014
PMID: 24656248
Multisensory constraints on awareness.
Deroy O, Chen YC, Spence C., Philos. Trans. R. Soc. Lond., B, Biol. Sci. 369(1641), 2014
PMID: 24639579
The Marble-Hand Illusion.
Senna I, Maravita A, Bolognini N, Parise CV., PLoS ONE 9(3), 2014
PMID: 24621793
Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants.
Baart M, Vroomen J, Shaw K, Bortfeld H., Cognition 130(1), 2014
PMID: 24141035
Auditory coding of human movement kinematics.
Vinken PM, Kroger D, Fehse U, Schmitz G, Brock H, Effenberg AO., Multisens Res 26(6), 2013
PMID: 24800411

20 References

Data provided by Europe PubMed Central.

Immediate perceptual response to intersensory discrepancy.
Welch RB, Warren DH., Psychol Bull 88(3), 1980
PMID: 7003641
Merging the senses into a robust percept.
Ernst MO, Bulthoff HH., Trends Cogn. Sci. (Regul. Ed.) 8(4), 2004
PMID: 15050512
Causal inference in perception.
Shams L, Beierholm UR., Trends Cogn. Sci. (Regul. Ed.) 14(9), 2010
PMID: 20705502
Feeling what you hear: auditory signals can modulate tactile tap perception.
Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A., Exp Brain Res 162(2), 2005
PMID: 15791465
The combination of vision and touch depends on spatial proximity
Gepshtein, J. Vis. 5(), 2005
Causal inference in multisensory perception.
Kording KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L., PLoS ONE 2(9), 2007
PMID: 17895984
Knowledge about a common source can promote visual- haptic integration.
Helbig HB, Ernst MO., Perception 36(10), 2007
PMID: 18265835
Auditory-visual interaction and the timing of inputs. Thomas (1941) revisited.
Radeau M, Bertelson P., Psychol Res 49(1), 1987
PMID: 3615744
Binocular cross-correlation in time and space.
Tyler CW., Vision Res. 18(1), 1978
PMID: 664265
Temporal mechanisms of multimodal binding.
Burr D, Silva O, Cicchini GM, Banks MS, Morrone MC., Proc. Biol. Sci. 276(1663), 2009
PMID: 19324779
Multimodal structure of the extrapersonal space
Grusser, 1983
Auditory-visual spatial integration: a new psychophysical approach using laser pointing to acoustic targets
Lewald, J. Acoust. Soc. Am. 104(), 1998

Knill, 1996

Blauert, 1997
Recalibration of audiovisual simultaneity.
Fujisaki W, Shimojo S, Kashino M, Nishida S., Nat. Neurosci. 7(7), 2004
PMID: 15195098


0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®


PMID: 22177899
PubMed | Europe PMC

Search this title in

Google Scholar