Capturing and Visualizing Eye Movements in 3D Environments

Pfeiffer T, Memili C, Renner P (2015)
In: Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). Pfeiffer T, Essig K (Eds); Bielefeld: eCollections Bielefeld University: 11-12.

Konferenzbeitrag | Veröffentlicht | Englisch
 
Download
OA 152.22 KB
Autor*in
Herausgeber*in
Pfeiffer, Thies; Essig, Kai
Abstract / Bemerkung
Visual attention can be a viable source of information to assess human behaviors in many different contexts, from human-computer interaction, over sports or social interactions, to complex working environments, such as to be found in the context of Industry 4.0. In such scenarios in which the user is able to walk around freely, mobile eye-tracking systems are used to record eye movements, which are then mapped onto an ego-perspective video. The analysis of such recordings then requires large efforts for manually annotating the recorded videos on a frame-by-frame basis to label the fixations based on their locations to the target objects present in the video. First, we present a method to record eye movements in 3D scenarios and annotate fixations with corresponding labels for the objects of interest in real-time 2. For this purpose, we rely on computer-vision methods for the detection of the camera position and orientation in the world. Based on a coarse 3D model of the environment, representing the 3D areas of interest, fixations are mapped to areas of interest. As a result, we can identify the position of the fixation in terms of local object coordinates for each relevant object of interest. Second, we present a method for real-time creation and visualization of heatmaps for 3D objects 1. Based on a live-streaming of the recorded and analyzed eye movements, our solution renders heatmaps on top of the object s urfaces. The resulting visualizations are more realistic than standard 2D heatmaps, in that we consider occlusions, depth of focus and dynamic moving objects. Third, we present a new method which allows us to aggregate fixations on a per object basis, e.g. similar to regions/areas of interest. This allows us to transfer existing methods of analysis to 3D environments. We present examples from a virtual supermarket, a study on social interactions between two humans, examples from real-time gaze mapping on body parts of a moving humans and from studying 3D prototypes in a virtual reality environment.
Stichworte
eye tracking
Erscheinungsjahr
2015
Titel des Konferenzbandes
Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015)
Seite(n)
11-12
Konferenz
SAGA 2015
Konferenzort
Bielefeld
Konferenzdatum
2015-09-29 – 2015-09-30
Page URI
https://pub.uni-bielefeld.de/record/2779322

Zitieren

Pfeiffer T, Memili C, Renner P. Capturing and Visualizing Eye Movements in 3D Environments. In: Pfeiffer T, Essig K, eds. Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). Bielefeld: eCollections Bielefeld University; 2015: 11-12.
Pfeiffer, T., Memili, C., & Renner, P. (2015). Capturing and Visualizing Eye Movements in 3D Environments. In T. Pfeiffer & K. Essig (Eds.), Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015) (pp. 11-12). Bielefeld: eCollections Bielefeld University. https://doi.org/10.2390/biecoll-saga2015_3
Pfeiffer, Thies, Memili, Cem, and Renner, Patrick. 2015. “Capturing and Visualizing Eye Movements in 3D Environments”. In Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015), ed. Thies Pfeiffer and Kai Essig, 11-12. Bielefeld: eCollections Bielefeld University.
Pfeiffer, T., Memili, C., and Renner, P. (2015). “Capturing and Visualizing Eye Movements in 3D Environments” in Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015), Pfeiffer, T., and Essig, K. eds. (Bielefeld: eCollections Bielefeld University), 11-12.
Pfeiffer, T., Memili, C., & Renner, P., 2015. Capturing and Visualizing Eye Movements in 3D Environments. In T. Pfeiffer & K. Essig, eds. Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). Bielefeld: eCollections Bielefeld University, pp. 11-12.
T. Pfeiffer, C. Memili, and P. Renner, “Capturing and Visualizing Eye Movements in 3D Environments”, Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015), T. Pfeiffer and K. Essig, eds., Bielefeld: eCollections Bielefeld University, 2015, pp.11-12.
Pfeiffer, T., Memili, C., Renner, P.: Capturing and Visualizing Eye Movements in 3D Environments. In: Pfeiffer, T. and Essig, K. (eds.) Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). p. 11-12. eCollections Bielefeld University, Bielefeld (2015).
Pfeiffer, Thies, Memili, Cem, and Renner, Patrick. “Capturing and Visualizing Eye Movements in 3D Environments”. Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). Ed. Thies Pfeiffer and Kai Essig. Bielefeld: eCollections Bielefeld University, 2015. 11-12.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
Dieses Objekt ist durch das Urheberrecht und/oder verwandte Schutzrechte geschützt. [...]
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2021-07-30T13:36:32Z
MD5 Prüfsumme
59f7405b3aa83b9cfc653a0dce6d0da7


Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar