Desynchronized speech-gesture signals still get the message across
Kirchhof C (2014)
Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kurzbeitrag Konferenz / Poster
| Veröffentlicht | Englisch
Download
Autor*in
Stichworte
subjects were asked to re-synchronize speech and gesture with a slider. Both studies show that the synchrony of the two modalities is far less significant in perception than was assumed a priori through the observation of production. In fact;
1985;
Kendon;
2004;
1980). We conducted two studies on the perceptual integration of desynchronized speech and gesture in listeners. In the first study;
people rated how natural asynchronies in multimodal stimuli felt to them;
both with speech before and after the gesture up to 600ms. In the second study;
2005;
McNeill;
2007;
robots;
etc. Strikingly in contrast to other areas of psycholinguistics;
the focus in gesture research has mainly been on production rather than perception (e.g. Feyereisen;
since the production synchrony is programmed into virtual agents;
Schegloff;
1984). Presumably;
the bimodal synchrony is deemed highly relevant for perception;
1998;
de Ruiter & Wilkins;
2000;
Krauss;
2000;
de Ruiter;
2011;
1980;
2004;
McNeill;
1985;
2005) and numerous studies have engaged in analyzing the significance of synchronized production for meaning creation: There is a semantic connection between the two modalities (e.g. Kirchhof;
audiovisual integration;
speech-gesture synchrony;
speech may precede or follow gesture by ±500 ms or more and one might not even notice. It follows that speech-gesture synchrony is merely a production phenomenon.
Key words: perception;
Abstract
Spontaneous gestures and concurrent speech are produced approximately simultaneously (e.g.Kendon
Erscheinungsjahr
2014
Seite(n)
44-44
Konferenz
7th International Conference on Multimodality (7ICOM)
Konferenzort
Hongkong
Konferenzdatum
2014-06-11 – 2014-06-13
Page URI
https://pub.uni-bielefeld.de/record/2703804
Zitieren
Kirchhof C. Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C. (2014). Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, Carolin. 2014. “Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong , 44-44.
Kirchhof, C. (2014).“Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
Kirchhof, C., 2014. Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong.
C. Kirchhof, “Desynchronized speech-gesture signals still get the message across”, Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong, 2014.
Kirchhof, C.: Desynchronized speech-gesture signals still get the message across. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong (2014).
Kirchhof, Carolin. “Desynchronized speech-gesture signals still get the message across”. Presented at the 7th International Conference on Multimodality (7ICOM), Hongkong, 2014.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
Dieses Objekt ist durch das Urheberrecht und/oder verwandte Schutzrechte geschützt. [...]
Volltext(e)
Name
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:27Z
MD5 Prüfsumme
73b994ab53b77caf0f590c6f43b8fdfc
Google Scholar