Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test

Parise C, Spence C (2012)
Experimental Brain Research 220(3-4): 319-333.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Parise, CesareUniBi; Spence, Charles
Abstract / Bemerkung
A growing body of empirical research on the topic of multisensory perception now shows that even non-synaesthetic individuals experience crossmodal correspondences, that is, apparently arbitrary compatibility effects between stimuli in different sensory modalities. In the present study, we replicated a number of classic results from the literature on crossmodal correspondences and highlight the existence of two new crossmodal correspondences using a modified version of the implicit association test (IAT). Given that only a single stimulus was presented on each trial, these results rule out selective attention and multisensory integration as possible mechanisms underlying the reported compatibility effects on speeded performance. The crossmodal correspondences examined in the present study all gave rise to very similar effect sizes, and the compatibility effect had a very rapid onset, thus speaking to the automatic detection of crossmodal correspondences. These results are further discussed in terms of the advantages of the IAT over traditional techniques for assessing the strength and symmetry of various crossmodal correspondences.
Stichworte
Multisensory perception; Vision; Audition; Crossmodal correspondences; Sound symbolism; Implicit association test
Erscheinungsjahr
2012
Zeitschriftentitel
Experimental Brain Research
Band
220
Ausgabe
3-4
Seite(n)
319-333
ISSN
0014-4819
eISSN
1432-1106
Page URI
https://pub.uni-bielefeld.de/record/2523715

Zitieren

Parise C, Spence C. Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test. Experimental Brain Research. 2012;220(3-4):319-333.
Parise, C., & Spence, C. (2012). Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test. Experimental Brain Research, 220(3-4), 319-333. doi:10.1007/s00221-012-3140-6
Parise, Cesare, and Spence, Charles. 2012. “Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test”. Experimental Brain Research 220 (3-4): 319-333.
Parise, C., and Spence, C. (2012). Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test. Experimental Brain Research 220, 319-333.
Parise, C., & Spence, C., 2012. Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test. Experimental Brain Research, 220(3-4), p 319-333.
C. Parise and C. Spence, “Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test”, Experimental Brain Research, vol. 220, 2012, pp. 319-333.
Parise, C., Spence, C.: Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test. Experimental Brain Research. 220, 319-333 (2012).
Parise, Cesare, and Spence, Charles. “Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test”. Experimental Brain Research 220.3-4 (2012): 319-333.

34 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Implicit associations between individual properties of color and sound.
Anikin A, Johansson N., Atten Percept Psychophys 81(3), 2019
PMID: 30547381
Semantic Associations Dominate Over Perceptual Associations in Vowel-Size Iconicity.
Hoshi H, Kwon N, Akita K, Auracher J., Iperception 10(4), 2019
PMID: 31321019
Are crossmodal correspondences relative or absolute? Sequential effects on speeded classification.
Brunetti R, Indraccolo A, Del Gatto C, Spence C, Santangelo V., Atten Percept Psychophys 80(2), 2018
PMID: 29116614
The Evolution of Musicality: What Can Be Learned from Language Evolution Research?
Ravignani A, Thompson B, Filippi P., Front Neurosci 12(), 2018
PMID: 29467601
Symmetry and its role in the crossmodal correspondence between shape and taste.
Turoman N, Velasco C, Chen YC, Huang PC, Spence C., Atten Percept Psychophys 80(3), 2018
PMID: 29260503
Five mechanisms of sound symbolic association.
Sidhu DM, Pexman PM., Psychon Bull Rev 25(5), 2018
PMID: 28840520
Phonological and orthographic influences in the bouba-kiki effect.
Cuskley C, Simner J, Kirby S., Psychol Res 81(1), 2017
PMID: 26403463
Low is large: spatial location and pitch interact in voice-based body size estimation.
Pisanski K, Isenstein SGE, Montano KJ, O'Connor JJM, Feinberg DR., Atten Percept Psychophys 79(4), 2017
PMID: 28229428
To call a cloud 'cirrus': sound symbolism in names for categories or items.
Ković V, Sučević J, Styles SJ., PeerJ 5(), 2017
PMID: 28674648
Embodied Cognition: A Challenging Road for Clinical Neuropsychology.
Cardona JF., Front Aging Neurosci 9(), 2017
PMID: 29213236
Color-Shape Associations in Deaf and Hearing People.
Chen N, Tanaka K, Namatame M, Watanabe K., Front Psychol 7(), 2016
PMID: 27014161
Crossmodal Correspondence Between Auditory Pitch and Visual Elevation Affects Temporal Ventriloquism.
Orchard-Mills E, Van der Burg E, Alais D., Perception 45(4), 2016
PMID: 26655643
Synesthesia strengthens sound-symbolic cross-modal correspondences.
Lacey S, Martinez M, McCormick K, Sathian K., Eur J Neurosci 44(9), 2016
PMID: 27564319
The pleasant heat? Evidence for thermal-emotional implicit associations occurring with semantic and physical thermal stimulation.
Bergman P, Ho HN, Koizumi A, Tajadura-Jiménez A, Kitagawa N., Cogn Neurosci 6(1), 2015
PMID: 25483026
Color-shape associations revealed with implicit association tests.
Chen N, Tanaka K, Watanabe K., PLoS One 10(1), 2015
PMID: 25625717
What's in a Name? Sound Symbolism and Gender in First Names.
Sidhu DM, Pexman PM., PLoS One 10(5), 2015
PMID: 26016856
Colour-temperature correspondences: when reactions to thermal stimuli are influenced by colour.
Ho HN, Van Doorn GH, Kawabe T, Watanabe J, Spence C., PLoS One 9(3), 2014
PMID: 24618675
Audiovisual correspondence between musical timbre and visual shapes.
Adeli M, Rouat J, Molotchnikoff S., Front Hum Neurosci 8(), 2014
PMID: 24910604
How automatic are crossmodal correspondences?
Spence C, Deroy O., Conscious Cogn 22(1), 2013
PMID: 23370382
Intersensory binding across space and time: a tutorial review.
Chen L, Vroomen J., Atten Percept Psychophys 75(5), 2013
PMID: 23709064
Effect of pitch-space correspondence on sound-induced visual motion perception.
Hidaka S, Teramoto W, Keetels M, Vroomen J., Exp Brain Res 231(1), 2013
PMID: 24030519

86 References

Daten bereitgestellt von Europe PubMed Central.

Effects of some variations in auditory input upon visual choice reaction time.
Bernstein IH, Edelstein BA., J Exp Psychol 87(2), 1971
PMID: 5542226

IV, Personal Soc Psychol Rev 6(), 2002
[Experimental research on the intermodal relationships between expressive qualities]
Bozzi P, Flores D'Arcais GB., Arch Psicol Neurol Psichiatr 28(5), 1967
PMID: 6080197
Similarly shaped letters evoke similar colors in grapheme-color synesthesia.
Brang D, Rouw R, Ramachandran VS, Coulson S., Neuropsychologia 49(5), 2011
PMID: 21219918

AUTHOR UNKNOWN, 0
Crossmodal semantic priming by naturalistic sounds and spoken words enhances visual sensitivity.
Chen YC, Spence C., J Exp Psychol Hum Percept Perform 37(5), 2011
PMID: 21688942

J, 1988
Can synaesthesia research inform cognitive science?
Cohen Kadosh R, Henik A., Trends Cogn. Sci. (Regul. Ed.) 11(4), 2007
PMID: 17331789
Small is bright and big is dark in synaesthesia.
Cohen Kadosh R, Henik A, Walsh V., Curr. Biol. 17(19), 2007
PMID: 17925208
Demonstration of cross-modal matching in rhesus monkeys, Macaca mulatta.
Cowey A, Weiskrantz L., Neuropsychologia 13(1), 1975
PMID: 1109455
Implicit association between basic tastes and pitch.
Crisinel AS, Spence C., Neurosci. Lett. 464(1), 2009
PMID: 19679162
Conditional and unconditional automaticity: a dual-process model of effects of spatial stimulus-response correspondence.
De Jong R, Liang CC, Lauber E., J Exp Psychol Hum Percept Perform 20(4), 1994
PMID: 8083631
Cross-modal associations between odors and colors.
Luisa Dematte M, Sanabria D, Spence C., Chem. Senses 31(6), 2006
PMID: 16648449
Olfactory-tactile compatibility effects demonstrated using a variation of the Implicit Association Test.
Luisa Dematte M, Sanabria D, Spence C., Acta Psychol (Amst) 124(3), 2006
PMID: 16762303
Five plus two equals yellow.
Dixon MJ, Smilek D, Cudahy C, Merikle PM., Nature 406(6794), 2000
PMID: 10935623
Learning to imitate novel motion sequences.
Agam Y, Galperin H, Gold BJ, Sekuler R., J Vis 7(5), 2007
PMID: 18217841

KK, J Vis 10(1), 2010

K, Eur Rev Soc Psychol 17(), 2006
Multisensory synesthetic interactions in the speeded classification of visual size.
Gallace A, Spence C., Percept Psychophys 68(7), 2006
PMID: 17355042
Measuring individual differences in implicit cognition: the implicit association test.
Greenwald AG, McGhee DE, Schwartz JL., J Pers Soc Psychol 74(6), 1998
PMID: 9654756
Mechanisms of synesthesia: cognitive and physiological constraints.
Grossenbacher PG, Lovelace CT., Trends Cogn. Sci. (Regul. Ed.) 5(1), 2001
PMID: 11164734

AUTHOR UNKNOWN, 0
Colours sometimes count: awareness and bidirectionality in grapheme-colour synaesthesia.
Johnson A, Jepma M, de Jong R., Q J Exp Psychol (Hove) 60(10), 2007
PMID: 17853248

AUTHOR UNKNOWN, 0

RL, Presence Teleoper Virtual Environ 9(4), 2000

R, 1987

W, 1929

W, 1947
The shape of words in the brain.
Kovic V, Plunkett K, Westermann G., Cognition 114(1), 2009
PMID: 19828141
Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans.
Ludwig VU, Adachi I, Matsuzawa T., Proc. Natl. Acad. Sci. U.S.A. 108(51), 2011
PMID: 22143791
On cross-modal similarity: auditory-visual interactions in speeded discrimination.
Marks LE., J Exp Psychol Hum Percept Perform 13(3), 1987
PMID: 2958587
On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness.
Marks LE., J Exp Psychol Hum Percept Perform 15(3), 1989
PMID: 2527964

LE, 2004

G, Curr Dir Psychol Sci 10(2), 2001

RD, J Exp Psychol Gen 116(4), 1987

RD, J Mem Lang 29(6), 1990

CB, Cogn Neuropsychol 16(2), 1999
Synaesthesia: supernormal integration?
Mulvenna CM, Walsh V., Trends Cogn. Sci. (Regul. Ed.) 10(8), 2006
PMID: 16843040

S, Am J Psychol 45(1), 1933

CE, Behav Sci 5(2), 1960

CE, 1957

T, Psychologia 41(), 1998
Evidence of sound symbolism in simple vocalizations.
Parise CV, Pavani F., Exp Brain Res 214(3), 2011
PMID: 21901453
Synesthetic congruency modulates the temporal ventriloquism effect.
Parise C, Spence C., Neurosci. Lett. 442(3), 2008
PMID: 18638522

AUTHOR UNKNOWN, 0
When correlation implies causation in multisensory integration.
Parise CV, Spence C, Ernst MO., Curr. Biol. 22(1), 2011
PMID: 22177899

A, 2004

A, J Appl Psychol 8(2), 1924

D, 2003

C, J Pers Soc Psychol 52(5), 1987

VS, Sci Am Spec Ed 17(2), 2007

D, New Sci 211(2821), 2011
A cross-cultural test of the Maluma-Takete phenomenon.
Rogers SK, Ross AS., Perception 4(1), 1975
PMID: 1161435

PJ, Am Stat 53(4), 1999
Tone-taste synesthesia: a replication.
Rudmin F, Cappelli M., Percept Mot Skills 56(1), 1983
PMID: 6844060

E, J Exp Psychol 12(3), 1929
Cross-modal integration between odors and abstract symbols.
Seo HS, Arshamian A, Schemmer K, Scheer I, Sander T, Ritter G, Hummel T., Neurosci. Lett. 478(3), 2010
PMID: 20470860

GM, 2012
Synesthesia in children: association of colors with pure tone frequencies.
SIMPSON RH, QUINN M, AUSUBEL DP., J Genet Psychol 89(1), 1956
PMID: 13429016
The ventriloquist in motion: illusory capture of dynamic information across sensory modalities.
Soto-Faraco S, Lyons J, Gazzaniga M, Spence C, Kingstone A., Brain Res Cogn Brain Res 14(1), 2002
PMID: 12063137
Crossmodal correspondences: a tutorial review.
Spence C., Atten Percept Psychophys 73(4), 2011
PMID: 21264748

AUTHOR UNKNOWN, 0
Multisensory integration: maintaining the perception of synchrony.
Spence C, Squire S., Curr. Biol. 13(13), 2003
PMID: 12842029
Cross-modality matching of brightness and loudness.
Stevens JC, Marks LE., Proc. Natl. Acad. Sci. U.S.A. 54(2), 1965
PMID: 5217429

K, 1883
Consistency in synesthetic experience to vowels and consonants: five case studies.
Svartdal F, Iversen T., Scand J Psychol 30(3), 1989
PMID: 2587966
Horizontal and vertical Simon effect: different underlying mechanisms?
Vallesi A, Mapelli D, Schiff S, Amodio P, Umilta C., Cognition 96(1), 2005
PMID: 15833304

K, Presence 7(4), 1998
Preverbal infants' sensitivity to synaesthetic cross-modality correspondences.
Walker P, Bremner JG, Mason U, Spring J, Mattock K, Slater A, Johnson SP., Psychol Sci 21(1), 2009
PMID: 20424017
QUEST: a Bayesian adaptive psychometric method.
Watson AB, Pelli DG., Percept Psychophys 33(2), 1983
PMID: 6844102
Cross-modal matching in the rhesus monkey using a single pair of stimuli.
Weiskrantz L, Cowey A., Neuropsychologia 13(3), 1975
PMID: 808744
Incorporating cross-modal statistics in the development and maintenance of multisensory integration.
Xu J, Yu L, Rowland BA, Stanford TR, Stein BE., J. Neurosci. 32(7), 2012
PMID: 22396404

MJ, J Gen Psychol 3(), 1930
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®
Quellen

PMID: 22706551
PubMed | Europe PMC

Suchen in

Google Scholar