Desynchronized speech-gesture signals still get the message across

Kirchhof C (2014)
Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.

Download
OA
Kurzbeitrag Konferenz | Veröffentlicht | Englisch
Volltext vorhanden für diesen Nachweis
Stichworte
subjects were asked to re-synchronize speech and gesture with a slider. Both studies show that the synchrony of the two modalities is far less significant in perception than was assumed a priori through the observation of production. In fact; 1985; Kendon; 2004; 1980). We conducted two studies on the perceptual integration of desynchronized speech and gesture in listeners. In the first study; people rated how natural asynchronies in multimodal stimuli felt to them; both with speech before and after the gesture up to 600ms. In the second study; 2005; McNeill; 2007; robots; etc. Strikingly in contrast to other areas of psycholinguistics; the focus in gesture research has mainly been on production rather than perception (e.g. Feyereisen; since the production synchrony is programmed into virtual agents; Schegloff; 1984). Presumably; the bimodal synchrony is deemed highly relevant for perception; 1998; de Ruiter & Wilkins; 2000; Krauss; 2000; de Ruiter; 2011; 1980; 2004; McNeill; 1985; 2005) and numerous studies have engaged in analyzing the significance of synchronized production for meaning creation: There is a semantic connection between the two modalities (e.g. Kirchhof; audiovisual integration; speech-gesture synchrony; speech may precede or follow gesture by ±500 ms or more and one might not even notice. It follows that speech-gesture synchrony is merely a production phenomenon. Key words: perception; Abstract Spontaneous gestures and concurrent speech are produced approximately simultaneously (e.g.Kendon
Erscheinungsjahr
Seite
44-44
Konferenz
7th International Conference on Multimodality (7ICOM)
Konferenzort
Hongkong
Konferenzdatum
2014-06-11 – 2014-06-13
PUB-ID

Zitieren

Kirchhof C. Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C. (2014). Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong
Kirchhof, C. (2014).“Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C., 2014. Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
C. Kirchhof, “Desynchronized speech-gesture signals still get the message across”, Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong, 2014.
Kirchhof, C.: Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong (2014).
Kirchhof, Carolin. “Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong, 2014.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2014-11-11T13:09:13Z

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar