Towards a Computational Model of Child Gesture-Speech Production

Abramov O, Kopp S, Nemeth A, Kern F, Mertens U, Rohlfing K (2018)
In: KOGWIS2018: Computational Approaches to Cognitive Science. Gesellschaft für Kognitionswissenschaft e.V. (Ed); .

Konferenzbeitrag | Veröffentlicht | Englisch
 
Download
OA 4.49 MB
hrerausgebende Körperschaft
Gesellschaft für Kognitionswissenschaft e.V.
Abstract / Bemerkung
Previous work by [1] studied gesture-speech interaction in adults. [1] focussed on temporal and semantic coordination of gesture and speech and found that while adult speech is mostly coordinated (or redundant) with gestures, semantic coordination increases the temporal synchrony. These observations do not necessarily hold for children (in particular with respect to iconic gestures, see [2]), where the speech and gesture systems are still under development. We studied the semantic and temporal coordination of speech and gesture in 4-year old children using a corpus of 40 children producing action descriptions in task oriented dialogues. In particular, we examined what kinds of information are transmitted verbally vs. non-verbally and how they are related. To account for this, we extended the semantic features (SFs) developed in [3] for object descriptions in order to include the semantics of actions. We coded the SFs on the children’s speech and gestures separately using video data. In our presentation, we will focus on the quantitative distribution of SFs across gesture and speech. Our results indicate that speech and gestures of 4-year olds are less integrated than those of the adults, although there is a large variability among the children. We will discuss the results with respect to the cognitive processes (e.g., visual memory, language) underlying children’s abilities at this stage of development. Our work paves the way for the cognitive architecture of speech-gesture interaction in preschoolers which to our knowledge is missing so far.
Stichworte
Speech-gesture integration; semantic features
Erscheinungsjahr
2018
Titel des Konferenzbandes
KOGWIS2018: Computational Approaches to Cognitive Science
Konferenz
KogWis 2018 Computational Approaches to Cognitive Science
Konferenzort
Darmstadt
Konferenzdatum
2018-09-03 – 2018-09-06
Page URI
https://pub.uni-bielefeld.de/record/2932018

Zitieren

Abramov O, Kopp S, Nemeth A, Kern F, Mertens U, Rohlfing K. Towards a Computational Model of Child Gesture-Speech Production. In: Gesellschaft für Kognitionswissenschaft e.V., ed. KOGWIS2018: Computational Approaches to Cognitive Science. 2018.
Abramov, O., Kopp, S., Nemeth, A., Kern, F., Mertens, U., & Rohlfing, K. (2018). Towards a Computational Model of Child Gesture-Speech Production. In Gesellschaft für Kognitionswissenschaft e.V. (Ed.), KOGWIS2018: Computational Approaches to Cognitive Science
Abramov, O., Kopp, S., Nemeth, A., Kern, F., Mertens, U., and Rohlfing, K. (2018). “Towards a Computational Model of Child Gesture-Speech Production” in KOGWIS2018: Computational Approaches to Cognitive Science, Gesellschaft für Kognitionswissenschaft e.V. ed.
Abramov, O., et al., 2018. Towards a Computational Model of Child Gesture-Speech Production. In Gesellschaft für Kognitionswissenschaft e.V., ed. KOGWIS2018: Computational Approaches to Cognitive Science.
O. Abramov, et al., “Towards a Computational Model of Child Gesture-Speech Production”, KOGWIS2018: Computational Approaches to Cognitive Science, Gesellschaft für Kognitionswissenschaft e.V., ed., 2018.
Abramov, O., Kopp, S., Nemeth, A., Kern, F., Mertens, U., Rohlfing, K.: Towards a Computational Model of Child Gesture-Speech Production. In: Gesellschaft für Kognitionswissenschaft e.V. (ed.) KOGWIS2018: Computational Approaches to Cognitive Science. (2018).
Abramov, Olga, Kopp, Stefan, Nemeth, Anne, Kern, Friederike, Mertens, Ulrich, and Rohlfing, Katharina. “Towards a Computational Model of Child Gesture-Speech Production”. KOGWIS2018: Computational Approaches to Cognitive Science. Ed. Gesellschaft für Kognitionswissenschaft e.V. 2018.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Volltext(e)
Name
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:19:02Z
MD5 Prüfsumme
c7d02236af625e6e0871755a91e18823

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar