A Computational Model of Acoustic Packaging

Schillingmann L, Wrede B, Rohlfing K (2009)
IEEE Transactions on Autonomous Mental Development 1(4): 226-237.

Journal Article | Published | English

No fulltext has been uploaded

Abstract
In order to learn and interact with humans, robots need to understand actions and make use of language in social interactions. The use of language for the learning of actions has been emphasized by Hirsh-Pasek and Golinkoff (MIT Press, 1996), introducing the idea of acoustic packaging. Accordingly, it has been suggested that acoustic information, typically in the form of narration, overlaps with action sequences and provides infants with a bottom-up guide to attend to relevant parts and to find structure within them. In this article, we present a computational model of the multimodal interplay of action and language in tutoring situations. For our purpose, we understand events as temporal intervals, which have to be segmented in both, the visual and the acoustic modality. Our acoustic packaging algorithm merges the segments from both modalities based on temporal overlap. First evaluation results show that acoustic packaging can provide a meaningful segmentation of action demonstration within tutoring behavior. We discuss our findings with regard to a meaningful action segmentation. Based on our future vision of acoustic packaging we point out a roadmap describing the further development of acoustic packaging and interactive scenarios it is employed in.
Publishing Year
ISSN
eISSN
PUB-ID

Cite this

Schillingmann L, Wrede B, Rohlfing K. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 2009;1(4):226-237.
Schillingmann, L., Wrede, B., & Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), 226-237.
Schillingmann, L., Wrede, B., and Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development 1, 226-237.
Schillingmann, L., Wrede, B., & Rohlfing, K., 2009. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), p 226-237.
L. Schillingmann, B. Wrede, and K. Rohlfing, “A Computational Model of Acoustic Packaging”, IEEE Transactions on Autonomous Mental Development, vol. 1, 2009, pp. 226-237.
Schillingmann, L., Wrede, B., Rohlfing, K.: A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 1, 226-237 (2009).
Schillingmann, Lars, Wrede, Britta, and Rohlfing, Katharina. “A Computational Model of Acoustic Packaging”. IEEE Transactions on Autonomous Mental Development 1.4 (2009): 226-237.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Search this title in

Google Scholar