A computational model for the representation and processing of shape in coverbal iconic gestures

Sowa T, Wachsmuth I (2009)
In: Spatial Language and Dialogue. Coventry KR, Tenbrink T, Bateman JA (Eds);Oxford: Oxford University Press: 132-146.

Download
OA
Book Chapter | Published | English
Author
;
Book Editor
Coventry, Kenny. R. ; Tenbrink, Thora ; Bateman, John A.
Abstract
When humans describe the shape of objects, they often use iconic gestures to depict what they want to convey to a listener. Gesturing gives them the ability to express spatial concepts directly in the spatial medium and thus provides an important communicative resource for spatial language. In order to harvest this resource in language comprehension systems, the composite signal conveyed in two different media has to be re-integrated to a common, unified meaning. In a corpus study, we examined the morphological variety of shape-related iconic gestures and the kind of shape information they express. We distinguish four sub-types of iconic gestures and show that the most frequent type, called dimensional gestures, and the lexical affiliates they co-occur with, contain information about an object’s spatial extent, the course of its boundary, and the spatial relations between object parts. An analysis of the verbal utterances shows that adjectives and nouns are predominant among the lexical affiliates in our scenario. Based on the empirical results, a computational model for the representation and processing of multimodal shape descriptions is proposed.
Publishing Year
PUB-ID

Cite this

Sowa T, Wachsmuth I. A computational model for the representation and processing of shape in coverbal iconic gestures. In: Coventry KR, Tenbrink T, Bateman JA, eds. Spatial Language and Dialogue. Oxford: Oxford University Press; 2009: 132-146.
Sowa, T., & Wachsmuth, I. (2009). A computational model for the representation and processing of shape in coverbal iconic gestures. In K. R. Coventry, T. Tenbrink, & J. A. Bateman (Eds.), Spatial Language and Dialogue (pp. 132-146). Oxford: Oxford University Press.
Sowa, T., and Wachsmuth, I. (2009). “A computational model for the representation and processing of shape in coverbal iconic gestures” in Spatial Language and Dialogue, ed. K. R. Coventry, T. Tenbrink, and J. A. Bateman (Oxford: Oxford University Press), 132-146.
Sowa, T., & Wachsmuth, I., 2009. A computational model for the representation and processing of shape in coverbal iconic gestures. In K. R. Coventry, T. Tenbrink, & J. A. Bateman, eds. Spatial Language and Dialogue. Oxford: Oxford University Press, pp. 132-146.
T. Sowa and I. Wachsmuth, “A computational model for the representation and processing of shape in coverbal iconic gestures”, Spatial Language and Dialogue, K.R. Coventry, T. Tenbrink, and J.A. Bateman, eds., Oxford: Oxford University Press, 2009, pp.132-146.
Sowa, T., Wachsmuth, I.: A computational model for the representation and processing of shape in coverbal iconic gestures. In: Coventry, K.R., Tenbrink, T., and Bateman, J.A. (eds.) Spatial Language and Dialogue. p. 132-146. Oxford University Press, Oxford (2009).
Sowa, Timo, and Wachsmuth, Ipke. “A computational model for the representation and processing of shape in coverbal iconic gestures”. Spatial Language and Dialogue. Ed. Kenny. R. Coventry, Thora Tenbrink, and John A. Bateman. Oxford: Oxford University Press, 2009. 132-146.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2013-11-08 00:20:51

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search