Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot

Lang S, Kleinehagenbrock M, Hohenner S, Fritsch J, Fink GA, Sagerer G (2003)
In: Proc. Int. Conf. on Multimodal Interfaces. Vancouver, Canada: ACM: 28-35.

Conference Paper | Published | English

No fulltext has been uploaded

Author
; ; ; ; ;
Abstract
In order to enable the widespread use of robots in home and office environments, systems with natural interaction capabilities have to be developed. A prerequisite for natural interaction is the robot’s ability to automatically recognize when and how long a person’s attention is directed towards it for communication. As in open environments several persons can be present simultaneously, the detection of the communication partner is of particular importance. In this paper we present an attention system for a mobile robot which enables the robot to shift its attention to the person of interest and to maintain attention during interaction. Our approach is based on a method for multi-modal person tracking which uses a pan-tilt camera for face recognition, two microphones for sound source localization, and a laser range finder for leg detection. Shifting of attention is realized by turning the camera into the direction of the person which is currently speaking. From the orientation of the head it is decided whether the speaker addresses the robot. The performance of the proposed approach is demonstrated with an evaluation. In addition, qualitative results from the performance of the robot at the exhibition part of the ICVS’03 are provided.
Publishing Year
PUB-ID

Cite this

Lang S, Kleinehagenbrock M, Hohenner S, Fritsch J, Fink GA, Sagerer G. Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot. In: Proc. Int. Conf. on Multimodal Interfaces. Vancouver, Canada: ACM; 2003: 28-35.
Lang, S., Kleinehagenbrock, M., Hohenner, S., Fritsch, J., Fink, G. A., & Sagerer, G. (2003). Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot. Proc. Int. Conf. on Multimodal Interfaces, 28-35.
Lang, S., Kleinehagenbrock, M., Hohenner, S., Fritsch, J., Fink, G. A., and Sagerer, G. (2003). “Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot” in Proc. Int. Conf. on Multimodal Interfaces (Vancouver, Canada: ACM), 28-35.
Lang, S., et al., 2003. Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot. In Proc. Int. Conf. on Multimodal Interfaces. Vancouver, Canada: ACM, pp. 28-35.
S. Lang, et al., “Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot”, Proc. Int. Conf. on Multimodal Interfaces, Vancouver, Canada: ACM, 2003, pp.28-35.
Lang, S., Kleinehagenbrock, M., Hohenner, S., Fritsch, J., Fink, G.A., Sagerer, G.: Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot. Proc. Int. Conf. on Multimodal Interfaces. p. 28-35. ACM, Vancouver, Canada (2003).
Lang, Sebastian, Kleinehagenbrock, Marcus, Hohenner, Sascha, Fritsch, Jannik, Fink, Gernot A., and Sagerer, Gerhard. “Providing the Basis for Human-Robot-Interaction: A Multi-Modal Attention System for a Mobile Robot”. Proc. Int. Conf. on Multimodal Interfaces. Vancouver, Canada: ACM, 2003. 28-35.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar