Capturing and Visualizing Eye Movements in 3D Environments

Pfeiffer T, Memili C, Renner P (2015)
In: Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). Pfeiffer T, Essig K (Eds);eCollections Bielefeld University: 11-12.

Conference Paper | Published | English

No fulltext has been uploaded

Editor
Pfeiffer, Thies ; Essig, Kai
Abstract
Visual attention can be a viable source of information to assess human behaviors in many different contexts, from human-computer interaction, over sports or social interactions, to complex working environments, such as to be found in the context of Industry 4.0. In such scenarios in which the user is able to walk around freely, mobile eye-tracking systems are used to record eye movements, which are then mapped onto an ego-perspective video. The analysis of such recordings then requires large efforts for manually annotating the recorded videos on a frame-by-frame basis to label the fixations based on their locations to the target objects present in the video. First, we present a method to record eye movements in 3D scenarios and annotate fixations with corresponding labels for the objects of interest in real-time 2. For this purpose, we rely on computer-vision methods for the detection of the camera position and orientation in the world. Based on a coarse 3D model of the environment, representing the 3D areas of interest, fixations are mapped to areas of interest. As a result, we can identify the position of the fixation in terms of local object coordinates for each relevant object of interest. Second, we present a method for real-time creation and visualization of heatmaps for 3D objects 1. Based on a live-streaming of the recorded and analyzed eye movements, our solution renders heatmaps on top of the object s urfaces. The resulting visualizations are more realistic than standard 2D heatmaps, in that we consider occlusions, depth of focus and dynamic moving objects. Third, we present a new method which allows us to aggregate fixations on a per object basis, e.g. similar to regions/areas of interest. This allows us to transfer existing methods of analysis to 3D environments. We present examples from a virtual supermarket, a study on social interactions between two humans, examples from real-time gaze mapping on body parts of a moving humans and from studying 3D prototypes in a virtual reality environment.
Keywords
Publishing Year
Conference
SAGA 2015
Location
Bielefeld
PUB-ID

Cite this

Pfeiffer T, Memili C, Renner P. Capturing and Visualizing Eye Movements in 3D Environments. In: Pfeiffer T, Essig K, eds. Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). eCollections Bielefeld University; 2015: 11-12.
Pfeiffer, T., Memili, C., & Renner, P. (2015). Capturing and Visualizing Eye Movements in 3D Environments. In T. Pfeiffer & K. Essig (Eds.), Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015) (pp. 11-12). eCollections Bielefeld University.
Pfeiffer, T., Memili, C., and Renner, P. (2015). “Capturing and Visualizing Eye Movements in 3D Environments” in Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015), ed. T. Pfeiffer and K. Essig (eCollections Bielefeld University), 11-12.
Pfeiffer, T., Memili, C., & Renner, P., 2015. Capturing and Visualizing Eye Movements in 3D Environments. In T. Pfeiffer & K. Essig, eds. Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). eCollections Bielefeld University, pp. 11-12.
T. Pfeiffer, C. Memili, and P. Renner, “Capturing and Visualizing Eye Movements in 3D Environments”, Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015), T. Pfeiffer and K. Essig, eds., eCollections Bielefeld University, 2015, pp.11-12.
Pfeiffer, T., Memili, C., Renner, P.: Capturing and Visualizing Eye Movements in 3D Environments. In: Pfeiffer, T. and Essig, K. (eds.) Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). p. 11-12. eCollections Bielefeld University (2015).
Pfeiffer, Thies, Memili, Cem, and Renner, Patrick. “Capturing and Visualizing Eye Movements in 3D Environments”. Proceedings of the 2nd International Workshop on Solutions for Automatic Gaze Data Analysis 2015 (SAGA 2015). Ed. Thies Pfeiffer and Kai Essig. eCollections Bielefeld University, 2015. 11-12.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar