Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning

Heckmann M, Brandl H, Schmüdderich J, Domont X, Bolder B, Mikhailova I, Janssen H, Joublin F, Goerick C (2009)
In: IEEE International Symposium on Robot and Human Interactive Communication.

Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Konferenzbeitrag | Veröffentlicht | Englisch
Autor
; ; ; ; ; ; ; ;
Abstract / Bemerkung
Based on inspirations from infant development we present a system which learns associations between acoustic labels and visual representations in interaction with its tutor. The system is implemented on a humanoid robot. Except for a few trigger phrases to start learning all acoustical representations are learned online and in interaction. Similar, for the visual domain the clusters are not predefined and fully learned online. In contrast to other interactive systems the interaction with the acoustic environment is solely based on the two microphones mounted on the robots head. In this paper we give an overview on all key elements of the system and focus on the challenges arising from the headset-free learning of speech labels. In particular we present a mechanism for auditory attention integrating bottom-up and top-down information for the segmentation of the acoustic stream. The performance of the system is evaluated based on offline tests of individual parts of the system and an analysis of the accompanying video showing the system in interaction.
Erscheinungsjahr
Titel des Konferenzbandes
IEEE International Symposium on Robot and Human Interactive Communication
Konferenzort
Toyama, Japan
PUB-ID

Zitieren

Heckmann M, Brandl H, Schmüdderich J, et al. Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. In: IEEE International Symposium on Robot and Human Interactive Communication. 2009.
Heckmann, M., Brandl, H., Schmüdderich, J., Domont, X., Bolder, B., Mikhailova, I., Janssen, H., et al. (2009). Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. IEEE International Symposium on Robot and Human Interactive Communication
Heckmann, M., Brandl, H., Schmüdderich, J., Domont, X., Bolder, B., Mikhailova, I., Janssen, H., Joublin, F., and Goerick, C. (2009). “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning” in IEEE International Symposium on Robot and Human Interactive Communication.
Heckmann, M., et al., 2009. Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. In IEEE International Symposium on Robot and Human Interactive Communication.
M. Heckmann, et al., “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning”, IEEE International Symposium on Robot and Human Interactive Communication, 2009.
Heckmann, M., Brandl, H., Schmüdderich, J., Domont, X., Bolder, B., Mikhailova, I., Janssen, H., Joublin, F., Goerick, C.: Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. IEEE International Symposium on Robot and Human Interactive Communication. (2009).
Heckmann, Martin, Brandl, Holger, Schmüdderich, Jens, Domont, Xavier, Bolder, Bram, Mikhailova, Inna, Janssen, Herbert, Joublin, Frank, and Goerick, Christian. “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning”. IEEE International Symposium on Robot and Human Interactive Communication. 2009.

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar