Feeling what you hear: auditory signals can modulate tactile tap perception

Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A (2005)
Experimental Brain Research 162(2): 172-180.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Bresciani, JP; Ernst, Marc O.UniBi; Drewing, K; Bouyer, G; Maury, V; Kheddar, A
Abstract / Bemerkung
We tested whether auditory sequences of beeps can modulate the tactile perception of sequences of taps ( two to four taps per sequence) delivered to the index fingertip. In the first experiment, the auditory and tactile sequences were presented simultaneously. The number of beeps delivered in the auditory sequence were either the same as, less than, or more than the number of taps of the simultaneously presented tactile sequence. Though task-irrelevant (subjects were instructed to focus on the tactile stimuli), the auditory stimuli systematically modulated subjects' tactile perception; in other words subjects' responses depended significantly on the number of delivered beeps. Such modulation only occurred when the auditory and tactile stimuli were similar enough. In the second experiment, we tested whether the automatic auditory-tactile integration depends on simultaneity or whether a bias can be evoked when the auditory and tactile sequence are presented in temporal asynchrony. Audition significantly modulated tactile perception when the stimuli were presented simultaneously but this effect gradually disappeared when a temporal asynchrony was introduced between auditory and tactile stimuli. These results show that when provided with auditory and tactile sensory signals that are likely to be generated by the same stimulus, the central nervous system (CNS) tends to automatically integrate these signals.
tactile; auditory; sensory systems; illusions; multimodal integration
Experimental Brain Research
Page URI


Bresciani JP, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A. Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental Brain Research. 2005;162(2):172-180.
Bresciani, J. P., Ernst, M. O., Drewing, K., Bouyer, G., Maury, V., & Kheddar, A. (2005). Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental Brain Research, 162(2), 172-180. https://doi.org/10.1007/s00221-004-2128-2
Bresciani, JP, Ernst, Marc O., Drewing, K, Bouyer, G, Maury, V, and Kheddar, A. 2005. “Feeling what you hear: auditory signals can modulate tactile tap perception”. Experimental Brain Research 162 (2): 172-180.
Bresciani, J. P., Ernst, M. O., Drewing, K., Bouyer, G., Maury, V., and Kheddar, A. (2005). Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental Brain Research 162, 172-180.
Bresciani, J.P., et al., 2005. Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental Brain Research, 162(2), p 172-180.
J.P. Bresciani, et al., “Feeling what you hear: auditory signals can modulate tactile tap perception”, Experimental Brain Research, vol. 162, 2005, pp. 172-180.
Bresciani, J.P., Ernst, M.O., Drewing, K., Bouyer, G., Maury, V., Kheddar, A.: Feeling what you hear: auditory signals can modulate tactile tap perception. Experimental Brain Research. 162, 172-180 (2005).
Bresciani, JP, Ernst, Marc O., Drewing, K, Bouyer, G, Maury, V, and Kheddar, A. “Feeling what you hear: auditory signals can modulate tactile tap perception”. Experimental Brain Research 162.2 (2005): 172-180.

50 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Decreased Temporal Sensorimotor Adaptation Due to Perturbation-Induced Measurement Noise.
Knelange EB, López-Moliner J., Front Hum Neurosci 13(), 2019
PMID: 30837854
Object discrepancy modulates feature prediction across eye movements.
Köller CP, Poth CH, Herwig A., Psychol Res (), 2018
PMID: 29387939
Hearing visuo-tactile synchrony - Sound-induced proprioceptive drift in the invisible hand illusion.
Darnai G, Szolcsányi T, Hegedüs G, Kincses P, Kállai J, Kovács M, Simon E, Nagy Z, Janszky J., Br J Psychol 108(1), 2017
PMID: 26918768
Background matters: Minor vibratory stimulation during motor skill acquisition selectively reduces off-line memory consolidation.
Korman M, Herling Z, Levy I, Egbarieh N, Engel-Yeger B, Karni A., Neurobiol Learn Mem 140(), 2017
PMID: 28189551
Walking to a multisensory beat.
Roy C, Lagarde J, Dotov D, Dalla Bella S., Brain Cogn 113(), 2017
PMID: 28257971
Voluntary and Involuntary Movements Widen the Window of Subjective Simultaneity.
Arikan BE, van Kemenade BM, Straube B, Harris LR, Kircher T., Iperception 8(4), 2017
PMID: 28835813
Kinematic cross-correlation induces sensory integration across separate objects.
Debats NB, Ernst MO, Heuer H., Eur J Neurosci 46(12), 2017
PMID: 29068094
The dominance of haptics over audition in controlling wrist velocity during striking movements.
Cao Y, Giordano BL, Avanzini F, McAdams S., Exp Brain Res 234(4), 2016
PMID: 26790425
Optimal visuotactile integration for velocity discrimination of self-hand movements.
Chancel M, Blanchard C, Guerraz M, Montagnini A, Kavounoudias A., J Neurophysiol 116(3), 2016
PMID: 27385802
Bias in Auditory Perception.
Sloos M, McKeown D., Iperception 6(5), 2015
PMID: 27648220
Spatiotemporal Processing in Crossmodal Interactions for Perception of the External World: A Review.
Hidaka S, Teramoto W, Sugita Y., Front Integr Neurosci 9(), 2015
PMID: 26733827
Audio-visual feedback improves the BCI performance in the navigational control of a humanoid robot.
Tidoni E, Gergondet P, Kheddar A, Aglioti SM., Front Neurorobot 8(), 2014
PMID: 24987350
Development of a tactile stimulator with simultaneous visual and auditory stimulation using E-Prime software.
Kim HS, Yeon HW, Choi MH, Kim JH, Choi JS, Park JY, Jun JH, Yi JH, Tack GR, Chung SC., Comput Methods Biomech Biomed Engin 16(5), 2013
PMID: 22149159
A practical system for recording instrument interactions during live robotic surgery.
McMahan W, Gomez ED, Chen L, Bark K, Nappo JC, Koch EI, Lee DI, Dumon KR, Williams NN, Kuchenbecker KJ., J Robot Surg 7(4), 2013
PMID: 27001874
Auditory stimuli from a sensor glove model modulate cortical audiotactile integration.
Mendes RM, Barbosa RI, Salmón CE, Rondinoni C, Escorsi-Rosset S, Delsim JC, Barbieri CH, Mazzer N., Neurosci Lett 548(), 2013
PMID: 23628668
The sound-induced phosphene illusion.
Bolognini N, Convento S, Fusaro M, Vallar G., Exp Brain Res 231(4), 2013
PMID: 24091771
When correlation implies causation in multisensory integration.
Parise CV, Spence C, Ernst MO., Curr Biol 22(1), 2012
PMID: 22177899
Tactual perception: a review of experimental variables and procedures.
Fernandes AM, Albuquerque PB., Cogn Process 13(4), 2012
PMID: 22669262
The effects of rhythmic sensory cues on the temporal dynamics of human gait.
Sejdić E, Fu Y, Pak A, Fairley JA, Chau T., PLoS One 7(8), 2012
PMID: 22927946
Early- and late-onset blindness both curb audiotactile integration on the parchment-skin illusion.
Champoux F, Collignon O, Bacon BA, Lepore F, Zatorre RJ, Théoret H., Psychol Sci 22(1), 2011
PMID: 21123856
Visual-haptic cue integration with spatial and temporal disparity during pointing movements.
Serwe S, Körding KP, Trommershäuser J., Exp Brain Res 210(1), 2011
PMID: 21374079
Audiotactile interactions in temporal perception.
Occelli V, Spence C, Zampini M., Psychon Bull Rev 18(3), 2011
PMID: 21400125
Perceived duration of Visual and Tactile Stimuli Depends on Perceived Speed.
Tomassini A, Gori M, Burr D, Sandini G, Morrone MC., Front Integr Neurosci 5(), 2011
PMID: 21941471
Audio-visual speech cue combination.
Arnold DH, Tear M, Schindel R, Roseboom W., PLoS One 5(4), 2010
PMID: 20419130
Multisensory cues improve sensorimotor synchronisation.
Elliott MT, Wing AM, Welchman AE., Eur J Neurosci 31(10), 2010
PMID: 20584187
Seeing the body modulates audiotactile integration.
Aspell JE, Lavanchy T, Lenggenhager B, Blanke O., Eur J Neurosci 31(10), 2010
PMID: 20584191
Optimality in mono- and multisensory map formation.
Bürck M, Friedel P, Sichert AB, Vossen C, van Hemmen JL., Biol Cybern 103(1), 2010
PMID: 20502911
Separate mechanisms for audio-tactile pitch and loudness interactions.
Yau JM, Weber AI, Bensmaia SJ., Front Psychol 1(), 2010
PMID: 21887147
Multisensory contributions to the perception of vibrotactile events.
Soto-Faraco S, Deco G., Behav Brain Res 196(2), 2009
PMID: 18930769
Sensory impairments and autism: a re-examination of causal modelling.
Gerrard S, Rugg G., J Autism Dev Disord 39(10), 2009
PMID: 19488845
Integration of auditory and vibrotactile stimuli: effects of phase and stimulus-onset asynchrony.
Wilson EC, Reed CM, Braida LD., J Acoust Soc Am 126(4), 2009
PMID: 19813808
Neural correlates of cross-modally induced changes in tactile awareness.
Hötting K, Friedrich CK, Röder B., J Cogn Neurosci 21(12), 2009
PMID: 19199403
Temporal recalibration to tactile-visual asynchronous stimuli.
Keetels M, Vroomen J., Neurosci Lett 430(2), 2008
PMID: 18055112
Multisensory temporal numerosity judgment.
Philippi TG, van Erp JB, Werkhoven PJ., Brain Res 1242(), 2008
PMID: 18620342
Selective effects of auditory stimuli on tactile roughness perception.
Suzuki Y, Gyoba J, Sakamoto S., Brain Res 1242(), 2008
PMID: 18638461
Adaptation to audiotactile asynchrony.
Navarra J, Soto-Faraco S, Spence C., Neurosci Lett 413(1), 2007
PMID: 17161530
Optimal integration of shape information from vision and touch.
Helbig HB, Ernst MO., Exp Brain Res 179(4), 2007
PMID: 17225091
Grasping at 'thin air': multimodal contact cues for reaching and grasping.
Zahariev MA, MacKenzie CL., Exp Brain Res 180(1), 2007
PMID: 17242914
Signal reliability modulates auditory-tactile integration for event counting.
Bresciani JP, Ernst MO., Neuroreport 18(11), 2007
PMID: 17589318
Binding of movement, sound and touch: multimodal coordination dynamics.
Lagarde J, Kelso JA., Exp Brain Res 173(4), 2006
PMID: 16528497
Spatiotemporal interactions between audition and touch depend on hand posture.
Sanabria D, Soto-Faraco S, Spence C., Exp Brain Res 165(4), 2005
PMID: 15942735

32 References

Daten bereitgestellt von Europe PubMed Central.

Synchronizing actions with events: the role of sensory information.
Aschersleben G, Prinz W., Percept Psychophys 57(3), 1995
PMID: 7770322

Aschersleben, Cognitive Processing 1(), 2002

Bermant, Percept Motor Skill 42(), 1976
Effects of an auditory signal on visual reaction time.
Bernstein IH, Clark MH, Edelstein BA., J Exp Psychol 80(3), 1969
PMID: 5786157
Cross-modal bias and perceptual fusion with auditory-visual spatial discordance.
Bertelson P, Radeau M., Percept Psychophys 29(6), 1981
PMID: 7279586
Visual areas in the temporal cortex of the macaque.
Desimone R, Gross CG., Brain Res. 178(2-3), 1979
PMID: 116712

DiFranco, P ASME 61(), 1997
Merging the senses into a robust percept.
Ernst MO, Bulthoff HH., Trends Cogn. Sci. (Regul. Ed.) 8(4), 2004
PMID: 15050512
The temporal cross-capture of audition and vision.
Fendrich R, Corballis PM., Percept Psychophys 63(4), 2001
PMID: 11436740
Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping.
Foxe JJ, Morocz IA, Murray MM, Higgins BA, Javitt DC, Schroeder CE., Brain Res Cogn Brain Res 10(1-2), 2000
PMID: 10978694
Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study.
Foxe JJ, Wylie GR, Martinez A, Schroeder CE, Javitt DC, Guilfoyle D, Ritter W, Murray MM., J. Neurophysiol. 88(1), 2002
PMID: 12091578

On the nature of intersensory facilitation of reaction time.
Gielen SC, Schmidt RA, Van den Heuvel PJ., Percept Psychophys 34(2), 1983
PMID: 6634374
Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction.
Gobbele R, Schurmann M, Forss N, Juottonen K, Buchner H, Hari R., Neuroimage 20(1), 2003
PMID: 14527610
Audiotactile interactions in roughness perception.
Guest S, Catmur C, Lloyd D, Spence C., Exp Brain Res 146(2), 2002
PMID: 12195518
Reaction time as a measure of intersensory facilitation.
HERSHENSON M., J Exp Psychol 63(), 1962
PMID: 13906889

Jousm, Curr Biol 8(), 1998
Functional properties of neurons in the temporo-parietal association cortex of awake monkey.
Leinonen L, Hyvarinen J, Sovijarvi AR., Exp Brain Res 39(2), 1980
PMID: 6772459
Magnetoencephalographic correlates of audiotactile interaction.
Lutkenhoner B, Lammertmann C, Simoes C, Hari R., Neuroimage 15(3), 2002
PMID: 11848694
Auditory capture of vision: examining temporal ventriloquism.
Morein-Zamir S, Soto-Faraco S, Kingstone A., Brain Res Cogn Brain Res 17(1), 2003
PMID: 12763201
Illusions. What you see is what you hear.
Shams L, Kamitani Y, Shimojo S., Nature 408(6814), 2000
PMID: 11130706
Visual illusion induced by sound.
Shams L, Kamitani Y, Shimojo S., Brain Res Cogn Brain Res 14(1), 2002
PMID: 12063138
Temporal and spatial dependency of the ventriloquism effect.
Slutsky DA, Recanzone GH., Neuroreport 12(1), 2001
PMID: 11201094

Wu, P ASME 67(), 1999

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

PMID: 15791465
PubMed | Europe PMC

Suchen in

Google Scholar