Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning
Heckmann M, Brandl H, Schmüdderich J, Domont X, Bolder B, Mikhailova I, Janssen H, Joublin F, Goerick C (2009)
In: IEEE International Symposium on Robot and Human Interactive Communication.
Konferenzbeitrag
| Veröffentlicht | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Heckmann, Martin;
Brandl, Holger;
Schmüdderich, Jens;
Domont, Xavier;
Bolder, Bram;
Mikhailova, Inna;
Janssen, Herbert;
Joublin, Frank;
Goerick, Christian
Einrichtung
Abstract / Bemerkung
Based on inspirations from infant development we present a system which learns associations between acoustic labels and visual representations in interaction with its tutor. The system is implemented on a humanoid robot. Except for a few trigger phrases to start learning all acoustical representations are learned online and in interaction. Similar, for the visual domain the clusters are not predefined and fully learned online. In contrast to other interactive systems the interaction with the acoustic environment is solely based on the two microphones mounted on the robots head. In this paper we give an overview on all key elements of the system and focus on the challenges arising from the headset-free learning of speech labels. In particular we present a mechanism for auditory attention integrating bottom-up and top-down information for the segmentation of the acoustic stream. The performance of the system is evaluated based on offline tests of individual parts of the system and an analysis of the accompanying video showing the system in interaction.
Erscheinungsjahr
2009
Titel des Konferenzbandes
IEEE International Symposium on Robot and Human Interactive Communication
Konferenzort
Toyama, Japan
Page URI
https://pub.uni-bielefeld.de/record/1890609
Zitieren
Heckmann M, Brandl H, Schmüdderich J, et al. Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. In: IEEE International Symposium on Robot and Human Interactive Communication. 2009.
Heckmann, M., Brandl, H., Schmüdderich, J., Domont, X., Bolder, B., Mikhailova, I., Janssen, H., et al. (2009). Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. IEEE International Symposium on Robot and Human Interactive Communication
Heckmann, Martin, Brandl, Holger, Schmüdderich, Jens, Domont, Xavier, Bolder, Bram, Mikhailova, Inna, Janssen, Herbert, Joublin, Frank, and Goerick, Christian. 2009. “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning”. In IEEE International Symposium on Robot and Human Interactive Communication.
Heckmann, M., Brandl, H., Schmüdderich, J., Domont, X., Bolder, B., Mikhailova, I., Janssen, H., Joublin, F., and Goerick, C. (2009). “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning” in IEEE International Symposium on Robot and Human Interactive Communication.
Heckmann, M., et al., 2009. Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. In IEEE International Symposium on Robot and Human Interactive Communication.
M. Heckmann, et al., “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning”, IEEE International Symposium on Robot and Human Interactive Communication, 2009.
Heckmann, M., Brandl, H., Schmüdderich, J., Domont, X., Bolder, B., Mikhailova, I., Janssen, H., Joublin, F., Goerick, C.: Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning. IEEE International Symposium on Robot and Human Interactive Communication. (2009).
Heckmann, Martin, Brandl, Holger, Schmüdderich, Jens, Domont, Xavier, Bolder, Bram, Mikhailova, Inna, Janssen, Herbert, Joublin, Frank, and Goerick, Christian. “Teaching a Humanoid Robot: Headset-Free Speech Interaction for Audio-Visual Association Learning”. IEEE International Symposium on Robot and Human Interactive Communication. 2009.
Google Scholar