Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions

Kopp S, Tepper P, Striegnitz K, Ferriman K, Cassell J (2007)
In: Conversational Informatics: an Engineering Approach. Nishida T (Ed); Wiley Series in Agent Technology. John Wiley & Sons: 133-160.

Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Sammelwerksbeitrag | Veröffentlicht | Englisch
Autor
; ; ; ;
Herausgeber
Abstract / Bemerkung
Humans intuitively accompany direction-giving with gestures. These gestures have been shown to have the same underlying conceptual structure as diagrams and direction-giving language, but the puzzle is how they communicate given that their form is not codified, and may in fact differ from one person or situation to the next. Based on results from a study on language and gesture in direction-giving, we describe a framework to analyze gestural images into semantic units (image description features), and to link these units to morphological features (hand shape, trajectory, etc.). This feature-based framework allows for implementing an integrated microplanner for multimodal directions that derives the form of both natural language and gesture directly from communicative goals. Using this microplanner we developed an embodied conversational agent that can perform appropriate speech and novel gestures in direction-giving conversation with real humans.
Erscheinungsjahr
Buchtitel
Conversational Informatics: an Engineering Approach
Seite
133-160
PUB-ID

Zitieren

Kopp S, Tepper P, Striegnitz K, Ferriman K, Cassell J. Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions. In: Nishida T, ed. Conversational Informatics: an Engineering Approach. Wiley Series in Agent Technology. John Wiley & Sons; 2007: 133-160.
Kopp, S., Tepper, P., Striegnitz, K., Ferriman, K., & Cassell, J. (2007). Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions. In T. Nishida (Ed.), Wiley Series in Agent Technology. Conversational Informatics: an Engineering Approach (pp. 133-160). John Wiley & Sons. doi:10.1002/9780470512470.ch8
Kopp, S., Tepper, P., Striegnitz, K., Ferriman, K., and Cassell, J. (2007). “Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions” in Conversational Informatics: an Engineering Approach, Nishida, T. ed. Wiley Series in Agent Technology (John Wiley & Sons), 133-160.
Kopp, S., et al., 2007. Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions. In T. Nishida, ed. Conversational Informatics: an Engineering Approach. Wiley Series in Agent Technology. John Wiley & Sons, pp. 133-160.
S. Kopp, et al., “Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions”, Conversational Informatics: an Engineering Approach, T. Nishida, ed., Wiley Series in Agent Technology, John Wiley & Sons, 2007, pp.133-160.
Kopp, S., Tepper, P., Striegnitz, K., Ferriman, K., Cassell, J.: Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions. In: Nishida, T. (ed.) Conversational Informatics: an Engineering Approach. Wiley Series in Agent Technology. p. 133-160. John Wiley & Sons (2007).
Kopp, Stefan, Tepper, P., Striegnitz, K., Ferriman, K., and Cassell, J. “Trading Spaces: How Humans and Humanoids Use Speech And Gesture to Give Directions”. Conversational Informatics: an Engineering Approach. Ed. Toyoaki Nishida. John Wiley & Sons, 2007. Wiley Series in Agent Technology. 133-160.

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche