Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output

Kopp S, Tepper P, Cassell J (2004)
In: Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04). New York, NY: ACM Press: 97-104.

Konferenzbeitrag | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Kopp, StefanUniBi ; Tepper, P.; Cassell, J.
Abstract / Bemerkung
When talking about spatial domains, humans frequently accompany their explanations with iconic gestures to depict what they are referring to. For example, when giving directions, it is common to see people making gestures that indicate the shape of buildings, or outline a route to be taken by the listener, and these gestures are essential to the understanding of the directions. Based on results from an ongoing study on language and gesture in direction-giving, we propose a framework to analyze such gestural images into semantic units (image description features), and to link these units to morphological features (hand shape, trajectory, etc.). This feature-based framework allows us to generate novel iconic gestures for embodied conversational agents, without drawing on a lexicon of canned gestures. We present an integrated microplanner that derives the form of both coordinated natural language and iconic gesture directly from given communicative goals, and serves as input to the speech and gesture realization engine in our NUMACK project.
Erscheinungsjahr
2004
Titel des Konferenzbandes
Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04)
Seite(n)
97-104
Konferenz
ICMI'04
ISBN
1-58113-995-0
Page URI
https://pub.uni-bielefeld.de/record/1857800

Zitieren

Kopp S, Tepper P, Cassell J. Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output. In: Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04). New York, NY: ACM Press; 2004: 97-104.
Kopp, S., Tepper, P., & Cassell, J. (2004). Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output. Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04), 97-104. New York, NY: ACM Press.
Kopp, Stefan, Tepper, P., and Cassell, J. 2004. “Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output”. In Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04), 97-104. New York, NY: ACM Press.
Kopp, S., Tepper, P., and Cassell, J. (2004). “Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output” in Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04) (New York, NY: ACM Press), 97-104.
Kopp, S., Tepper, P., & Cassell, J., 2004. Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output. In Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04). New York, NY: ACM Press, pp. 97-104.
S. Kopp, P. Tepper, and J. Cassell, “Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output”, Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04), New York, NY: ACM Press, 2004, pp.97-104.
Kopp, S., Tepper, P., Cassell, J.: Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output. Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04). p. 97-104. ACM Press, New York, NY (2004).
Kopp, Stefan, Tepper, P., and Cassell, J. “Towards Integrated Microplanning of Language and Iconic Gesture for Multimodal Output”. Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI'04). New York, NY: ACM Press, 2004. 97-104.
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche