A Computational Model of Acoustic Packaging

Schillingmann L, Wrede B, Rohlfing K (2009)
IEEE Transactions on Autonomous Mental Development 1(4): 226-237.

Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Zeitschriftenaufsatz | Veröffentlicht | Englisch
Abstract / Bemerkung
In order to learn and interact with humans, robots need to understand actions and make use of language in social interactions. The use of language for the learning of actions has been emphasized by Hirsh-Pasek and Golinkoff (MIT Press, 1996), introducing the idea of acoustic packaging. Accordingly, it has been suggested that acoustic information, typically in the form of narration, overlaps with action sequences and provides infants with a bottom-up guide to attend to relevant parts and to find structure within them. In this article, we present a computational model of the multimodal interplay of action and language in tutoring situations. For our purpose, we understand events as temporal intervals, which have to be segmented in both, the visual and the acoustic modality. Our acoustic packaging algorithm merges the segments from both modalities based on temporal overlap. First evaluation results show that acoustic packaging can provide a meaningful segmentation of action demonstration within tutoring behavior. We discuss our findings with regard to a meaningful action segmentation. Based on our future vision of acoustic packaging we point out a roadmap describing the further development of acoustic packaging and interactive scenarios it is employed in.
Erscheinungsjahr
Zeitschriftentitel
IEEE Transactions on Autonomous Mental Development
Band
1
Zeitschriftennummer
4
Seite
226-237
ISSN
eISSN
PUB-ID

Zitieren

Schillingmann L, Wrede B, Rohlfing K. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 2009;1(4):226-237.
Schillingmann, L., Wrede, B., & Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), 226-237. doi:10.1109/TAMD.2009.2039135
Schillingmann, L., Wrede, B., and Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development 1, 226-237.
Schillingmann, L., Wrede, B., & Rohlfing, K., 2009. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), p 226-237.
L. Schillingmann, B. Wrede, and K. Rohlfing, “A Computational Model of Acoustic Packaging”, IEEE Transactions on Autonomous Mental Development, vol. 1, 2009, pp. 226-237.
Schillingmann, L., Wrede, B., Rohlfing, K.: A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 1, 226-237 (2009).
Schillingmann, Lars, Wrede, Britta, and Rohlfing, Katharina. “A Computational Model of Acoustic Packaging”. IEEE Transactions on Autonomous Mental Development 1.4 (2009): 226-237.