Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction

Renner P, Pfeiffer T (2014)
In: Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14, . New York, NY, USA: ACM: 361-362.

Download
OA
Conference Paper | Published | English
Abstract
For solving complex tasks cooperatively in close interaction with robots, they need to understand natural human communication. To achieve this, robots could benefit from a deeper understanding of the processes that humans use for successful communication. Such skills can be studied by investigating human face-to-face interactions in complex tasks. In our work the focus lies on shared-space interactions in a path planning task and thus 3D gaze directions and hand movements are of particular interest. However, the analysis of gaze and gestures is a time-consuming task: Usually, manual annotation of the eye tracker's scene camera video is necessary in a frame-by-frame manner. To tackle this issue, based on the EyeSee3D method, an automatic approach for annotating interactions is presented: A combination of geometric modeling and 3D marker tracking serves to align real world stimuli with virtual proxies. This is done based on the scene camera images of the mobile eye tracker alone. In addition to the EyeSee3D approach, face detection is used to automatically detect fixations on the interlocutor. For the acquisition of the gestures, an optical marker tracking system is integrated and fused in the multimodal representation of the communicative situation.
Publishing Year
PUB-ID

Cite this

Renner P, Pfeiffer T. Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. In: Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM; 2014: 361-362.
Renner, P., & Pfeiffer, T. (2014). Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. Proceedings of the Symposium on Eye Tracking Research and Applications, 361-362.
Renner, P., and Pfeiffer, T. (2014). “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction” in Proceedings of the Symposium on Eye Tracking Research and Applications ETRA '14 (New York, NY, USA: ACM), 361-362.
Renner, P., & Pfeiffer, T., 2014. Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. In Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM, pp. 361-362.
P. Renner and T. Pfeiffer, “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”, Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA '14, New York, NY, USA: ACM, 2014, pp.361-362.
Renner, P., Pfeiffer, T.: Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. p. 361-362. ACM, New York, NY, USA (2014).
Renner, Patrick, and Pfeiffer, Thies. “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”. Proceedings of the Symposium on Eye Tracking Research and Applications. New York, NY, USA: ACM, 2014. ETRA '14. 361-362.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2014-03-29 20:06:19

Supplementary Material
File Title
Poster
Description
Poster going along with the short paper submission.
Access Level
OA Open Access
Last Uploaded
2014-03-29 20:18:14
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search