Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments

Pfeiffer T, Latoschik ME (2004)
In: Proceedings of the IEEE Virtual Reality 2004. Ikei Y, Göbel M, Chen J (Eds); 35-42.

Konferenzbeitrag | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Pfeiffer, ThiesUniBi ; Latoschik, M. E.
Herausgeber*in
Ikei, Yasushi; Göbel, Martin; Chen, Jim
Abstract / Bemerkung
This paper describes the underlying concepts and the technical implementation of a system for resolving multimodal references in Virtual Reality (VR). In this system the temporal and semantic relations intrinsic to referential utterances are expressed as a constraint satisfaction problem, where the propositional value of each referential unit during a multimodal dialogue updates incrementally the active set of constraints. As the system is based on findings of human cognition research it also regards, e.g., constraints implicitly assumed by human communicators. The implementation takes VR related real-time and immersive conditions into account and adapts its architecture to well known scene-graph based design patterns by introducing a socalled reference resolution engine. Regarding the conceptual work as well as regarding the implementation, special care has been taken to allow further refinements and modifications to the underlying resolving processes on a high level basis.
Stichworte
inform::Constraint Satisfaction inform::Multimodality inform::Virtual Reality ling::Natural Language Processing ling::Reference Resolution; Multimodal Communication
Erscheinungsjahr
2004
Titel des Konferenzbandes
Proceedings of the IEEE Virtual Reality 2004
Seite(n)
35-42
ISBN
0-7803-8415-6
Page URI
https://pub.uni-bielefeld.de/record/1894806

Zitieren

Pfeiffer T, Latoschik ME. Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In: Ikei Y, Göbel M, Chen J, eds. Proceedings of the IEEE Virtual Reality 2004. 2004: 35-42.
Pfeiffer, T., & Latoschik, M. E. (2004). Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In Y. Ikei, M. Göbel, & J. Chen (Eds.), Proceedings of the IEEE Virtual Reality 2004 (pp. 35-42).
Pfeiffer, Thies, and Latoschik, M. E. 2004. “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments”. In Proceedings of the IEEE Virtual Reality 2004, ed. Yasushi Ikei, Martin Göbel, and Jim Chen, 35-42.
Pfeiffer, T., and Latoschik, M. E. (2004). “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments” in Proceedings of the IEEE Virtual Reality 2004, Ikei, Y., Göbel, M., and Chen, J. eds. 35-42.
Pfeiffer, T., & Latoschik, M.E., 2004. Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In Y. Ikei, M. Göbel, & J. Chen, eds. Proceedings of the IEEE Virtual Reality 2004. pp. 35-42.
T. Pfeiffer and M.E. Latoschik, “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments”, Proceedings of the IEEE Virtual Reality 2004, Y. Ikei, M. Göbel, and J. Chen, eds., 2004, pp.35-42.
Pfeiffer, T., Latoschik, M.E.: Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In: Ikei, Y., Göbel, M., and Chen, J. (eds.) Proceedings of the IEEE Virtual Reality 2004. p. 35-42. (2004).
Pfeiffer, Thies, and Latoschik, M. E. “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments”. Proceedings of the IEEE Virtual Reality 2004. Ed. Yasushi Ikei, Martin Göbel, and Jim Chen. 2004. 35-42.

Link(s) zu Volltext(en)
Access Level
Restricted Closed Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche