PUB - Publikationen an der Universität Bielefeld

The paper reports on eye-tracking research as it has been going on in diierent institutions at Bielefeld University. Initially, a short introduction into eye-tracker technology is given and the two scenarios used in the investigation of agents' behaviour in task-oriented dialogue are presented: A 2D-setting working with one eye-tracker that records the visual attention of the instructor, and a 3D-setting using eye-tracking for the instructor as well as for the constructor. To our knowledge, the 3D-setting is the rst one that has been developed for the investigation of agents' actions in dialogue. Subsequently, it is shown that the investigation of situated language behaviour can proot a lot from the application of eye-tracker-technology: We present the results of three empirical studies, two 2D-studies and one using the 3D-setting. They reveal interesting interdependencies between focussing, planning, language production and the organization of larger units in discourse such as sequences of turns. Intermediate results from this research line have been presented at the following institutions, symposia, work-shops and congresses: Modellierung epistemischer Propositionen, KI 94 (Univ. of Saarbr ucken); IBM Conference on Focus, 94 (Schloo Birlinghofen, Kassel); IBM Wissenschaftliches Zentrum, 94 (Heidelberg); 1. Fachtagung der Gesellschaft f ur Kognitionswissenschaft, 94 (Freiburg); KI 95 (Univ. of Bielefeld); Workshop of the Special Col-laborative Research Program 245, \Language and Situation", 95 (Univ. of Heidelberg); SFB-Status-Colloquium, 95 (ZiF, Univ. of Bielefeld); 2. Fachtagung der Gesellschaft f ur Kognitionswissenschaft, 96 (Univ. of Ham-burg); Graduiertenkolleg Kognitionswissenschaft, 96 (Univ. of Hamburg); Workshop \Perspektive in Sprache und Raum", 96 (TU, Berlin); Workshop on Metonymy, 96 (Univ. of Hamburg); KONVENS 96 (Univ. of Bielefeld); MunDial97, Formal Semantics and Pragmatics of Dialogue, 97 (Univ. of Munich); Seminar on Focus and Refer-ence, 97 (CogSci/HCRC, Edinburg Univ.); Seminar on Eye-tracker Research, 97 (Trinity College, Dublin); Fokus und Aufmerksamkeit, 97 (Univ./GSH Essen); Lexikalische Semantik aus kognitiver Sicht, 97 (Univ. Osnabr uck); Lecture series \Koordination von Sprache und Handlung" KIFS/IK 98 (G unne pp. 61{75. In setting up this manuscript the authors were supported by Bjj orn Knaaa, member of the Cody project, Technical Faculty at Bielefeld University, who provided the graphical representations of the airplane parts. The work in the Cody project is reported on in Wachsmuth and Jung, 1996]. Thanks also to Peter K uhnlein, who did the T E Xing.