Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints

Bergmann K, Kahl S, Kopp S (2013)
In: Intelligent Virtual Agents. Aylett R, Krenn B, Pelachaud C, Shimodaira H (Eds); Lecture Notes in Artificial Intelligence. Berlin/Heidelberg: Springer: 203-216.

Download
OA
Konferenzbeitrag | Veröffentlicht | Englisch
Herausgeber
; ; ;
Abstract / Bemerkung
This paper addresses the semantic coordination of speech and gesture, a major prerequisite when endowing virtual agents with convincing multimodal behavior. Previous research has focused on build- ing rule- or data-based models speci c for a particular language, culture or individual speaker, but without considering the underlying cognitive processes. We present a exible cognitive model in which both linguistic as well as cognitive constraints are considered in order to simulate natu- ral semantic coordination across speech and gesture. An implementation of this model is presented and rst simulation results, compatible with empirical data from the literature are reported.
Erscheinungsjahr
Titel des Konferenzbandes
Intelligent Virtual Agents
Seite
203-216
Konferenz
13th International Conference on Intelligent Virtual Agents
Konferenzort
Edinburgh, UK
Konferenzdatum
2013-08-29 – 2013-08-31
PUB-ID

Zitieren

Bergmann K, Kahl S, Kopp S. Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints. In: Aylett R, Krenn B, Pelachaud C, Shimodaira H, eds. Intelligent Virtual Agents. Lecture Notes in Artificial Intelligence. Berlin/Heidelberg: Springer; 2013: 203-216.
Bergmann, K., Kahl, S., & Kopp, S. (2013). Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints. In R. Aylett, B. Krenn, C. Pelachaud, & H. Shimodaira (Eds.), Lecture Notes in Artificial Intelligence. Intelligent Virtual Agents (pp. 203-216). Berlin/Heidelberg: Springer.
Bergmann, K., Kahl, S., and Kopp, S. (2013). “Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints” in Intelligent Virtual Agents, Aylett, R., Krenn, B., Pelachaud, C., and Shimodaira, H. eds. Lecture Notes in Artificial Intelligence (Berlin/Heidelberg: Springer), 203-216.
Bergmann, K., Kahl, S., & Kopp, S., 2013. Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints. In R. Aylett, et al., eds. Intelligent Virtual Agents. Lecture Notes in Artificial Intelligence. Berlin/Heidelberg: Springer, pp. 203-216.
K. Bergmann, S. Kahl, and S. Kopp, “Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints”, Intelligent Virtual Agents, R. Aylett, et al., eds., Lecture Notes in Artificial Intelligence, Berlin/Heidelberg: Springer, 2013, pp.203-216.
Bergmann, K., Kahl, S., Kopp, S.: Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints. In: Aylett, R., Krenn, B., Pelachaud, C., and Shimodaira, H. (eds.) Intelligent Virtual Agents. Lecture Notes in Artificial Intelligence. p. 203-216. Springer, Berlin/Heidelberg (2013).
Bergmann, Kirsten, Kahl, Sebastian, and Kopp, Stefan. “Modeling the semantic coordination of speech and gesture under cognitive and linguistic constraints”. Intelligent Virtual Agents. Ed. R. Aylett, B. Krenn, C. Pelachaud, and H. Shimodaira. Berlin/Heidelberg: Springer, 2013. Lecture Notes in Artificial Intelligence. 203-216.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2016-03-09T09:54:39Z

Externes Material:
Zusatzmaterial
Beschreibung
Production demo video A demo video of our cognitive model of speech & gesture production.

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche