Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction

Renner P, Pfeiffer T (2014)
In: Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM: 361-362.

Konferenzbeitrag | Veröffentlicht | Englisch
 
Download
OA
Abstract / Bemerkung
For solving complex tasks cooperatively in close interaction with robots, they need to understand natural human communication. To achieve this, robots could benefit from a deeper understanding of the processes that humans use for successful communication. Such skills can be studied by investigating human face-to-face interactions in complex tasks. In our work the focus lies on shared-space interactions in a path planning task and thus 3D gaze directions and hand movements are of particular interest. However, the analysis of gaze and gestures is a time-consuming task: Usually, manual annotation of the eye tracker's scene camera video is necessary in a frame-by-frame manner. To tackle this issue, based on the EyeSee3D method, an automatic approach for annotating interactions is presented: A combination of geometric modeling and 3D marker tracking serves to align real world stimuli with virtual proxies. This is done based on the scene camera images of the mobile eye tracker alone. In addition to the EyeSee3D approach, face detection is used to automatically detect fixations on the interlocutor. For the acquisition of the gestures, an optical marker tracking system is integrated and fused in the multimodal representation of the communicative situation.
Stichworte
Eyetracking; geometric modelling; motion tracking; Gaze-based Interaction; 3D gaze analysis; Augmented Reality; eye tracking; marker tracking
Erscheinungsjahr
2014
Titel des Konferenzbandes
Proceedings of the Symposium on Eye Tracking Research and Applications
Serien- oder Zeitschriftentitel
ETRA '14
Seite(n)
361-362
ISBN
978-1-4503-2751-0
Page URI
https://pub.uni-bielefeld.de/record/2666049

Zitieren

Renner P, Pfeiffer T. Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. In: Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM; 2014: 361-362.
Renner, P., & Pfeiffer, T. (2014). Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA '14, 361-362. New York, NY, USA: ACM. doi:10.1145/2578153.2582176
Renner, Patrick, and Pfeiffer, Thies. 2014. “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”. In Proceedings of the Symposium on Eye Tracking Research and Applications, 361-362. ETRA '14. New York, NY, USA: ACM.
Renner, P., and Pfeiffer, T. (2014). “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction” in Proceedings of the Symposium on Eye Tracking Research and Applications ETRA '14 (New York, NY, USA: ACM), 361-362.
Renner, P., & Pfeiffer, T., 2014. Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. In Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. New York, NY, USA: ACM, pp. 361-362.
P. Renner and T. Pfeiffer, “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”, Proceedings of the Symposium on Eye Tracking Research and Applications, ETRA '14, New York, NY, USA: ACM, 2014, pp.361-362.
Renner, P., Pfeiffer, T.: Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction. Proceedings of the Symposium on Eye Tracking Research and Applications. ETRA '14. p. 361-362. ACM, New York, NY, USA (2014).
Renner, Patrick, and Pfeiffer, Thies. “Model-based acquisition and analysis of multimodal interactions for improving human-robot interaction”. Proceedings of the Symposium on Eye Tracking Research and Applications. New York, NY, USA: ACM, 2014. ETRA '14. 361-362.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
Dieses Objekt ist durch das Urheberrecht und/oder verwandte Schutzrechte geschützt. [...]
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:22Z
MD5 Prüfsumme
6054f9f86e3b7a3c2d0682c1791af749

Zusatzmaterial
Titel
Poster
Beschreibung
Poster going along with the short paper submission.
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:22Z
MD5 Prüfsumme
86cac463ddab76229183e2301ccf0aa9

Link(s) zu Volltext(en)
Access Level
Restricted Closed Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche