Organizing Multimodal Perception for Autonomous Learning and Interactive Systems

Schmüdderich J, Brandl H, Bolder B, Heracles M, Janssen H, Mikhailova I, Goerick C (2008)
In: 8th IEEE International conference on humanoid robotics. Daejeon, Korea: IEEE.

Conference Paper | Published | English

No fulltext has been uploaded

Author
; ; ; ; ; ;
Abstract
A stable perception of the environment is a crucial prerequisite for researching the learning of semantics from interaction between a robot and a tutor and also for the generation of behavior relying on the robots perception. For the organization of visual perception the concept of protoobjects is used to represent scene elements. These proto-objects are created by several different sources and can be combined to provide the means for interactive autonomous behavior generation. Several classifiers use these proto-objects for the extraction of visual properties. These properties are used for online training of a speech recognition system, which learns speech labels for the visual properties. To ease the combination of visual and speech classifier outputs, necessary for the online training and basis for later learning of semantics, a common representation for all classifier results is used. This uniform handling of multimodal information provides the necessary flexibility for further extension. We will show the feasibility of the proposed approach by interactive experiments with the humanoid robot ASIMO.
Publishing Year
Location
Daejeon, Korea
Conference Date
2008-01-12
PUB-ID

Cite this

Schmüdderich J, Brandl H, Bolder B, et al. Organizing Multimodal Perception for Autonomous Learning and Interactive Systems. In: 8th IEEE International conference on humanoid robotics. Daejeon, Korea: IEEE; 2008.
Schmüdderich, J., Brandl, H., Bolder, B., Heracles, M., Janssen, H., Mikhailova, I., & Goerick, C. (2008). Organizing Multimodal Perception for Autonomous Learning and Interactive Systems. 8th IEEE International conference on humanoid robotics.
Schmüdderich, J., Brandl, H., Bolder, B., Heracles, M., Janssen, H., Mikhailova, I., and Goerick, C. (2008). “Organizing Multimodal Perception for Autonomous Learning and Interactive Systems” in 8th IEEE International conference on humanoid robotics (Daejeon, Korea: IEEE).
Schmüdderich, J., et al., 2008. Organizing Multimodal Perception for Autonomous Learning and Interactive Systems. In 8th IEEE International conference on humanoid robotics. Daejeon, Korea: IEEE.
J. Schmüdderich, et al., “Organizing Multimodal Perception for Autonomous Learning and Interactive Systems”, 8th IEEE International conference on humanoid robotics, Daejeon, Korea: IEEE, 2008.
Schmüdderich, J., Brandl, H., Bolder, B., Heracles, M., Janssen, H., Mikhailova, I., Goerick, C.: Organizing Multimodal Perception for Autonomous Learning and Interactive Systems. 8th IEEE International conference on humanoid robotics. IEEE, Daejeon, Korea (2008).
Schmüdderich, Jens, Brandl, Holger, Bolder, Bram, Heracles, Martin, Janssen, Herbert, Mikhailova, Inna, and Goerick, Christian. “Organizing Multimodal Perception for Autonomous Learning and Interactive Systems”. 8th IEEE International conference on humanoid robotics. Daejeon, Korea: IEEE, 2008.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar