Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction

Renner P, Pfeiffer T (2014)
In: Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM: 361-362.

Download
OA
Konferenzbeitrag | Veröffentlicht | Englisch
Volltext vorhanden für diesen Nachweis
Abstract / Bemerkung
For solving complex tasks cooperatively in close interaction with robots, they need to understand natural human communication. To achieve this, robots could benefit from a deeper understanding of the processes that humans use for successful communication. Such skills can be studied by investigating human face-to-face interactions in complex tasks. In our work the focus lies on shared-space interactions in a path planning task and thus 3D gaze directions and hand movements are of particular interest. However, the analysis of gaze and gestures is a time-consuming task: Usually, manual annotation of the eye tracker's scene camera video is necessary in a frame-by-frame manner. To tackle this issue, based on the EyeSee3D method, an automatic approach for annotating interactions is presented: A combination of geometric modeling and 3D marker tracking serves to align real world stimuli with virtual proxies. This is done based on the scene camera images of the mobile eye tracker alone. In addition to the EyeSee3D approach, face detection is used to automatically detect fixations on the interlocutor. For the acquisition of the gestures, an optical marker tracking system is integrated and fused in the multimodal representation of the communicative situation.
Erscheinungsjahr
Titel des Konferenzbandes
Proceedings of the Symposium on Eye Tracking Research and Applications
Seite
361-362
PUB-ID

Zitieren

Renner P, Pfeiffer T. Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. In: Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM; 2014: 361-362.
Renner, P., & Pfeiffer, T. (2014). Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA '14, 361-362. New York, NY, USA: ACM. doi:10.1145/2578153.2582176
Renner, P., and Pfeiffer, T. (2014). “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction” in Proceedings of the Symposium on Eye Tracking Research and Applications ETRA '14 (New York, NY, USA: ACM), 361-362.
Renner, P., & Pfeiffer, T., 2014. Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. In Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM, pp. 361-362.
P. Renner and T. Pfeiffer, “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”, Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA '14, New York, NY, USA: ACM, 2014, pp.361-362.
Renner, P., Pfeiffer, T.: Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. p. 361-362. ACM, New York, NY, USA (2014).
Renner, Patrick, and Pfeiffer, Thies. “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”. Proceedings of the Symposium on Eye Tracking Research and Applications. New York, NY, USA: ACM, 2014. ETRA '14. 361-362.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2014-03-29T20:06:19Z

Zusatzmaterial
Titel
Poster
Beschreibung
Poster going along with the short paper submission.
Access Level
OA Open Access
Zuletzt Hochgeladen
2014-03-29T20:18:14Z
Link(s) zu Volltext(en)
Access Level
Restricted Closed Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche