'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

Parise C, Spence C (2009)
PLoS ONE 4(5): e5664.

Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Zeitschriftenaufsatz | Veröffentlicht | Englisch
Autor
;
Abstract / Bemerkung
Background: Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e., unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic associations in multisensory integration has not been considered previously. Methodology: Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli. Principal Findings: The reliability of non-synesthetic participants' estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli. Conclusions: Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information.
Erscheinungsjahr
Zeitschriftentitel
PLoS ONE
Band
4
Ausgabe
5
Seite(n)
e5664
ISSN
eISSN
PUB-ID

Zitieren

Parise C, Spence C. 'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE. 2009;4(5):e5664.
Parise, C., & Spence, C. (2009). 'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE, 4(5), e5664. doi:10.1371/journal.pone.0005664
Parise, C., and Spence, C. (2009). 'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE 4, e5664.
Parise, C., & Spence, C., 2009. 'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE, 4(5), p e5664.
C. Parise and C. Spence, “'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes”, PLoS ONE, vol. 4, 2009, pp. e5664.
Parise, C., Spence, C.: 'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes. PLoS ONE. 4, e5664 (2009).
Parise, Cesare, and Spence, Charles. “'When Birds of a Feather Flock Together': Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes”. PLoS ONE 4.5 (2009): e5664.

68 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

The Influence of Number Magnitude on Vocal Responses.
Vainio L, Mustonen T, Vainio M., J Mot Behav 51(2), 2019
PMID: 29522383
Sound changes that lead to seeing longer-lasting shapes.
Samuel AG, Tangella K., Atten Percept Psychophys 80(4), 2018
PMID: 29380283
The influence of phasic alerting on multisensory temporal precision.
Li Q, Liu P, Huang S, Huang X., Exp Brain Res 236(12), 2018
PMID: 30242427
Dual-task interference effects on cross-modal numerical order and sound intensity judgments: the more the louder?
Alards-Tomalin D, Walker AC, Nepon H, Leboe-McGowan LC., Q J Exp Psychol (Hove) 70(9), 2017
PMID: 27442724
Summation of visual attributes in auditory-visual crossmodal correspondences.
Jonas C, Spiller MJ, Hibbard P., Psychon Bull Rev 24(4), 2017
PMID: 28695529
The Influence of Auditory Information on Visual Size Adaptation.
Tonelli A, Cuturi LF, Gori M., Front Neurosci 11(), 2017
PMID: 29114201
Crossmodal Correspondences: Four Challenges.
Deroy O, Spence C., Multisens Res 29(1-3), 2016
PMID: 27311290
The COGs (context, object, and goals) in multisensory processing.
ten Oever S, Romei V, van Atteveldt N, Soto-Faraco S, Murray MM, Matusz PJ., Exp Brain Res 234(5), 2016
PMID: 26931340
Shaking Takete and Flowing Maluma. Non-Sense Words Are Associated with Motion Patterns.
Koppensteiner M, Stephan P, Jäschke JP., PLoS One 11(3), 2016
PMID: 26939013
Crossmodal Correspondence Between Auditory Pitch and Visual Elevation Affects Temporal Ventriloquism.
Orchard-Mills E, Van der Burg E, Alais D., Perception 45(4), 2016
PMID: 26655643
The Tactile Dimensions of Abstract Paintings: A Cross-Modal Study.
Albertazzi L, Bacci F, Canal L, Micciolo R., Perception 45(7), 2016
PMID: 27071636
Synesthesia and music perception.
Bragança GFF, Fonseca JGM, Caramelli P., Dement Neuropsychol 9(1), 2015
PMID: 29213937
Cross-modal associations between materic painting and classical Spanish music.
Albertazzi L, Canal L, Micciolo R., Front Psychol 6(), 2015
PMID: 25954217
Chromatic Dimensions Earthy, Watery, Airy, and Fiery.
Albertazzi L, Koenderink JJ, van Doorn A., Perception 44(10), 2015
PMID: 26562887
Crossmodal interactions during affective picture processing.
Ferrari V, Mastria S, Bruno N., PLoS One 9(2), 2014
PMID: 24587078
Shared processing of planning articulatory gestures and grasping.
Vainio L, Tiainen M, Tiippana K, Vainio M., Exp Brain Res 232(7), 2014
PMID: 24710666
Audiovisual correspondence between musical timbre and visual shapes.
Adeli M, Rouat J, Molotchnikoff S., Front Hum Neurosci 8(), 2014
PMID: 24910604
Tones and numbers: a combined EEG-MEG study on the effects of musical expertise in magnitude comparisons of audiovisual stimuli.
Paraskevopoulos E, Kuchenbuch A, Herholz SC, Foroglou N, Bamidis P, Pantev C., Hum Brain Mapp 35(11), 2014
PMID: 24916460
How automatic are crossmodal correspondences?
Spence C, Deroy O., Conscious Cogn 22(1), 2013
PMID: 23370382
Are we all born synaesthetic? Examining the neonatal synaesthesia hypothesis.
Deroy O, Spence C., Neurosci Biobehav Rev 37(7), 2013
PMID: 23603186
Audio-visual onset differences are used to determine syllable identity for ambiguous audio-visual stimulus pairs.
Ten Oever S, Sack AT, Wheat KL, Bien N, van Atteveldt N., Front Psychol 4(), 2013
PMID: 23805110
Intersensory binding across space and time: a tutorial review.
Chen L, Vroomen J., Atten Percept Psychophys 75(5), 2013
PMID: 23709064
Why we are not all synesthetes (not even weakly so).
Deroy O, Spence C., Psychon Bull Rev 20(4), 2013
PMID: 23413012
Naturalistic stimulus structure determines the integration of audiovisual looming signals in binocular rivalry.
Conrad V, Kleiner M, Bartels A, Hartcher O'Brien J, Bülthoff HH, Noppeney U., PLoS One 8(8), 2013
PMID: 24015176
Effect of pitch-space correspondence on sound-induced visual motion perception.
Hidaka S, Teramoto W, Keetels M, Vroomen J., Exp Brain Res 231(1), 2013
PMID: 24030519
Effects of temporal asynchrony and stimulus magnitude on competitive audio-visual binding.
Wilbiks JM, Dyson BJ., Atten Percept Psychophys 75(8), 2013
PMID: 23955058
Perceived size change induced by audiovisual temporal delays.
Jaekl P, Soto-Faraco S, Harris LR., Exp Brain Res 216(3), 2012
PMID: 22105336
When correlation implies causation in multisensory integration.
Parise CV, Spence C, Ernst MO., Curr Biol 22(1), 2012
PMID: 22177899
A common scheme for cross-sensory correspondences across stimulus domains.
Walker L, Walker P, Francis B., Perception 41(10), 2012
PMID: 23469700
Multistability, cross-modal binding and the additivity of conjoined grouping principles.
Kubovy M, Yu M., Philos Trans R Soc Lond B Biol Sci 367(1591), 2012
PMID: 22371617
Sounds exaggerate visual shape.
Sweeny TD, Guzman-Martinez E, Ortega L, Grabowecky M, Suzuki S., Cognition 124(2), 2012
PMID: 22633004
The cognitive neuroscience of crossmodal correspondences.
Spence C, Parise CV., Iperception 3(7), 2012
PMID: 23145291
Does crossmodal correspondence modulate the facilitatory effect of auditory cues on visual search?
Klapetek A, Ngo MK, Spence C., Atten Percept Psychophys 74(6), 2012
PMID: 22648604
Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
Spence C, Deroy O., Iperception 3(8), 2012
PMID: 23145309
No effect of synesthetic congruency on temporal ventriloquism.
Keetels M, Vroomen J., Atten Percept Psychophys 73(1), 2011
PMID: 21258920
Crossmodal correspondences: a tutorial review.
Spence C., Atten Percept Psychophys 73(4), 2011
PMID: 21264748
Crossmodal associations between flavoured milk solutions and musical notes.
Crisinel AS, Spence C., Acta Psychol (Amst) 138(1), 2011
PMID: 21696696
Evidence of sound symbolism in simple vocalizations.
Parise CV, Pavani F., Exp Brain Res 214(3), 2011
PMID: 21901453
Prior-entry: a review.
Spence C, Parise C., Conscious Cogn 19(1), 2010
PMID: 20056554
What sound does that taste? Cross-modal mappings across gustation and audition.
Simner J, Cuskley C, Kirby S., Perception 39(4), 2010
PMID: 20515002
Implicit association between basic tastes and pitch.
Crisinel AS, Spence C., Neurosci Lett 464(1), 2009
PMID: 19679162
Crossmodal processing.
Spence C, Senkowski D, Röder B., Exp Brain Res 198(2-3), 2009
PMID: 19690844

39 References

Daten bereitgestellt von Europe PubMed Central.

Multisensory synesthetic interactions in the speeded classification of visual size.
Gallace A, Spence C., Percept Psychophys 68(7), 2006
PMID: 17355042
On cross-modal similarity: auditory-visual interactions in speeded discrimination.
Marks LE., 1987
On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness.
Marks LE., 1989
Cross-modal interactions in speeded classification.
Marks L., 2004
Synesthesia: Strong and weak.
Martino G, Marks LE., 2001
Interaction between synesthetically corresponding dimensions.
Melara RD, O'Brien TP., 1987
Synesthetic congruency modulates the temporal ventriloquism effect.
Parise C, Spence C., Neurosci. Lett. 442(3), 2008
PMID: 18638522
Can synaesthesia research inform cognitive science?
Cohen Kadosh R, Henik A., Trends Cogn. Sci. (Regul. Ed.) 11(4), 2007
PMID: 17331789
A study in phonetic symbolism.
Sapir E., 1929
Effects of some variations in auditory input upon visual choice reaction time.
Bernstein IH, Edelstein BA., J Exp Psychol 87(2), 1971
PMID: 5542226
Automatic visual bias of perceived auditory location.
Bertelson P, Aschersleben G., 1998
Auditory capture of vision: examining temporal ventriloquism.
Morein-Zamir S, Soto-Faraco S, Kingstone A., Brain Res Cogn Brain Res 17(1), 2003
PMID: 12763201
Temporal and spatial dependency of the ventriloquism effect.
Slutsky DA, Recanzone GH., Neuroreport 12(1), 2001
PMID: 11201094
Immediate perceptual response to intersensory discrepancy.
Welch R, Warren D., 1980
A Bayesian view on multimodal cue integration.
Ernst M., 2005
Combining sensory information: mandatory fusion within, but not between, senses.
Hillis JM, Ernst MO, Banks MS, Landy MS., Science 298(5598), 2002
PMID: 12446912
The effect of viewpoint on perceived visual roughness.
Ho YX, Maloney LT, Landy MS., J Vis 7(1), 2007
PMID: 17461669
Knowledge about a common source can promote visual- haptic integration.
Helbig HB, Ernst MO., Perception 36(10), 2007
PMID: 18265835
Vision and touch are automatically integrated for the perception of sequences of events.
Bresciani J, Dammeier F, Ernst M., 2006
Eye movements and the perception of a clear and stable visual world.
Martinez-Conde S, Krauzlis R, Miller J, Morrone C, Williams D, Kowler E., J Vis 8(14), 2008
PMID: 19350710
Visual prior entry.
Shore DI, Spence C, Klein RM., Psychol Sci 12(3), 2001
PMID: 11437302
QUEST: a Bayesian adaptive psychometric method.
Watson AB, Pelli DG., Percept Psychophys 33(2), 1983
PMID: 6844102
The psychometric function: I. Fitting, sampling, and goodness of fit.
Wichmann FA, Hill NJ., Percept Psychophys 63(8), 2001
PMID: 11800458
The effect of viewpoint on perceived visual roughness.
Ho YX, Maloney LT, Landy MS., J Vis 7(1), 2007
PMID: 17461669
The impact of signal bandwidth on auditory localization: implications for the design of three-dimensional audio displays.
King R, Oldfield S., 1997
A method for obtaining and analyzing sensitivity data.
Dixon W, Mood A., 1948
The method of constant stimuli is inefficient.
Watson AB, Fitzhugh A., Percept Psychophys 47(1), 1990
PMID: 2300429
Temporal mechanisms of multimodal binding.
Burr D, Silva O, Cicchini GM, Banks MS, Morrone MC., Proc. Biol. Sci. 276(1663), 2009
PMID: 19324779
Spatial and temporal contrast-sensitivity functions of the visual system.
Robson J., 1966

AUTHOR UNKNOWN, 2004
The bagplot: A bivariate boxplot.
Rousseeuw PJ, Ruts I, Tukey JW., 1999

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

Quellen

PMID: 19471644
PubMed | Europe PMC

Suchen in

Google Scholar