A Computational Model of Acoustic Packaging

Schillingmann L, Wrede B, Rohlfing K (2009)
IEEE Transactions on Autonomous Mental Development 1(4): 226-237.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Abstract / Bemerkung
In order to learn and interact with humans, robots need to understand actions and make use of language in social interactions. The use of language for the learning of actions has been emphasized by Hirsh-Pasek and Golinkoff (MIT Press, 1996), introducing the idea of acoustic packaging. Accordingly, it has been suggested that acoustic information, typically in the form of narration, overlaps with action sequences and provides infants with a bottom-up guide to attend to relevant parts and to find structure within them. In this article, we present a computational model of the multimodal interplay of action and language in tutoring situations. For our purpose, we understand events as temporal intervals, which have to be segmented in both, the visual and the acoustic modality. Our acoustic packaging algorithm merges the segments from both modalities based on temporal overlap. First evaluation results show that acoustic packaging can provide a meaningful segmentation of action demonstration within tutoring behavior. We discuss our findings with regard to a meaningful action segmentation. Based on our future vision of acoustic packaging we point out a roadmap describing the further development of acoustic packaging and interactive scenarios it is employed in.
Erscheinungsjahr
2009
Zeitschriftentitel
IEEE Transactions on Autonomous Mental Development
Band
1
Ausgabe
4
Seite(n)
226-237
ISSN
1943-0604
eISSN
1943-0612
Page URI
https://pub.uni-bielefeld.de/record/1890394

Zitieren

Schillingmann L, Wrede B, Rohlfing K. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 2009;1(4):226-237.
Schillingmann, L., Wrede, B., & Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), 226-237. doi:10.1109/TAMD.2009.2039135
Schillingmann, L., Wrede, B., and Rohlfing, K. (2009). A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development 1, 226-237.
Schillingmann, L., Wrede, B., & Rohlfing, K., 2009. A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development, 1(4), p 226-237.
L. Schillingmann, B. Wrede, and K. Rohlfing, “A Computational Model of Acoustic Packaging”, IEEE Transactions on Autonomous Mental Development, vol. 1, 2009, pp. 226-237.
Schillingmann, L., Wrede, B., Rohlfing, K.: A Computational Model of Acoustic Packaging. IEEE Transactions on Autonomous Mental Development. 1, 226-237 (2009).
Schillingmann, Lars, Wrede, Britta, and Rohlfing, Katharina. “A Computational Model of Acoustic Packaging”. IEEE Transactions on Autonomous Mental Development 1.4 (2009): 226-237.