Analysing the Modifying Functions of Gesture in Multimodal Utterances

Freigang F, Kopp S (2015)
In: Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN). .

Download
OA
Conference Paper | Published | English
Abstract
Gestures may contribute to the meaning of an utterance not only by adding information but also by modifying the gestural or verbal content uttered in parallel. The phenomenon of modification is more common in natural interaction than it has been given attention. We created a corpus of natural communicative gestures and body movements and conducted a study to examine their modifying functions. Results show that index-finger-pointings are most prominent, which emphasise and affirm an uttered content and, thus, are not only used for referencing but also for modifying. Holds emphasise and colour the utterance by showing a stance towards something. Brushing gestures change the utterance in a discounting or downtoning way. A cluster analysis suggests four distinct categories: a focusing category for emphasising an aspect, an epistemic-attitudinal category to convey one’s own stance, an epistemic category for uncertainty, and a category where multiple viewpoints are discussed.
Publishing Year
Location
Nantes, France
Conference Date
2015-09-02 – 2015-09-04
PUB-ID

Cite this

Freigang F, Kopp S. Analysing the Modifying Functions of Gesture in Multimodal Utterances. In: Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN). 2015.
Freigang, F., & Kopp, S. (2015). Analysing the Modifying Functions of Gesture in Multimodal Utterances. Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN).
Freigang, F., and Kopp, S. (2015). “Analysing the Modifying Functions of Gesture in Multimodal Utterances” in Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN).
Freigang, F., & Kopp, S., 2015. Analysing the Modifying Functions of Gesture in Multimodal Utterances. In Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN).
F. Freigang and S. Kopp, “Analysing the Modifying Functions of Gesture in Multimodal Utterances”, Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN), 2015.
Freigang, F., Kopp, S.: Analysing the Modifying Functions of Gesture in Multimodal Utterances. Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN). (2015).
Freigang, Farina, and Kopp, Stefan. “Analysing the Modifying Functions of Gesture in Multimodal Utterances”. Proceedings of the 4th Conference on Gesture and Speech in Interaction (GESPIN). 2015.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2015-09-08 14:40:47

Supplementary Material
File Title
Gespin Supplement 1
Access Level
OA Open Access
Last Uploaded
2015-07-22 13:00:02
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar