Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios

Schillingmann L, Wagner P, Munier C, Wrede B, Rohlfing K (2011)
In: Interspeech 2011 (12th Annual Conference of the International Speech Communication Association). 3105-3108.

Konferenzbeitrag | Veröffentlicht | Englisch
 
Download
OA
Abstract / Bemerkung
Robots interacting with humans need to understand actions and make use of language in social interactions. Research on infant development has shown that language helps the learner to structure visual observations of action. This acoustic information typically in the form of narration overlaps with action sequences and provides infants with a bottom-up guide to find structure within them. This concept has been introduced as acoustic packaging by Hirsh-Pasek and Golinkoff. We developed and integrated a prominence detection module in our acoustic packaging system to detect semantically relevant information linguistically highlighted by the tutor. Evaluation results on speech data from adult-infant interactions show a significant agreement with human raters. Furthermore a first approach based on acoustic packages which uses the prominence detection results to generate acoustic feedback is presented. Index Terms: prominence, multimodal action segmentation, human robot interaction, feedback
Stichworte
Feedback; Human Robot Interaction; Prominence; Multimodal Action Segmentation
Erscheinungsjahr
2011
Titel des Konferenzbandes
Interspeech 2011 (12th Annual Conference of the International Speech Communication Association)
Seite(n)
3105-3108
Konferenz
Interspeech 2011 (12th Annual Conference of the International Speech Communication Association)
Konferenzort
Florence, Italy
Konferenzdatum
2011-08-27
Page URI
https://pub.uni-bielefeld.de/record/2144469

Zitieren

Schillingmann L, Wagner P, Munier C, Wrede B, Rohlfing K. Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios. In: Interspeech 2011 (12th Annual Conference of the International Speech Communication Association). 2011: 3105-3108.
Schillingmann, L., Wagner, P., Munier, C., Wrede, B., & Rohlfing, K. (2011). Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios. Interspeech 2011 (12th Annual Conference of the International Speech Communication Association), 3105-3108.
Schillingmann, L., Wagner, P., Munier, C., Wrede, B., and Rohlfing, K. (2011). “Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios” in Interspeech 2011 (12th Annual Conference of the International Speech Communication Association) 3105-3108.
Schillingmann, L., et al., 2011. Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios. In Interspeech 2011 (12th Annual Conference of the International Speech Communication Association). pp. 3105-3108.
L. Schillingmann, et al., “Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios”, Interspeech 2011 (12th Annual Conference of the International Speech Communication Association), 2011, pp.3105-3108.
Schillingmann, L., Wagner, P., Munier, C., Wrede, B., Rohlfing, K.: Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios. Interspeech 2011 (12th Annual Conference of the International Speech Communication Association). p. 3105-3108. (2011).
Schillingmann, Lars, Wagner, Petra, Munier, Christian, Wrede, Britta, and Rohlfing, Katharina. “Using Prominence Detection to Generate Acoustic Feedback in Tutoring Scenarios”. Interspeech 2011 (12th Annual Conference of the International Speech Communication Association). 2011. 3105-3108.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T08:57:33Z
MD5 Prüfsumme
825259ead031327615d339148cd015bc

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar