Desynchronized speech-gesture signals still get the message across

Kirchhof C (2014)
Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.

Download
OA
Conference Abstract | Published | English
Keywords
subjects were asked to re-synchronize speech and gesture with a slider. Both studies show that the synchrony of the two modalities is far less significant in perception than was assumed a priori through the observation of production. In fact ; 1985 ; Kendon ; 2004 ; 1980). We conducted two studies on the perceptual integration of desynchronized speech and gesture in listeners. In the first study ; people rated how natural asynchronies in multimodal stimuli felt to them ; both with speech before and after the gesture up to 600ms. In the second study ; 2005 ; McNeill ; 2007 ; robots ; etc. Strikingly in contrast to other areas of psycholinguistics ; the focus in gesture research has mainly been on production rather than perception (e.g. Feyereisen ; since the production synchrony is programmed into virtual agents ; Schegloff ; 1984). Presumably ; the bimodal synchrony is deemed highly relevant for perception ; 1998 ; de Ruiter & Wilkins ; 2000 ; Krauss ; 2000 ; de Ruiter ; 2011 ; 1980 ; 2004 ; McNeill ; 1985 ; 2005) and numerous studies have engaged in analyzing the significance of synchronized production for meaning creation: There is a semantic connection between the two modalities (e.g. Kirchhof ; audiovisual integration ; speech-gesture synchrony ; speech may precede or follow gesture by ±500 ms or more and one might not even notice. It follows that speech-gesture synchrony is merely a production phenomenon. Key words: perception ; Abstract Spontaneous gestures and concurrent speech are produced approximately simultaneously (e.g.Kendon
Publishing Year
Conference
7th International Conference on Multimodality (7ICOM)
Location
Hongkong
Conference Date
2014-06-11 – 2014-06-13
PUB-ID

Cite this

Kirchhof C. Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C. (2014). Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C. (2014).“Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C., 2014. Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
C. Kirchhof, “Desynchronized speech-gesture signals still get the message across”, Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong, 2014.
Kirchhof, C.: Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong (2014).
Kirchhof, Carolin. “Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong, 2014.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2014-11-11 13:09:13

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar