Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments

Pfeiffer T, Latoschik ME (2004)
In: Proceedings of the IEEE Virtual Reality 2004. Ikei Y, Göbel M, Chen J (Eds); 35-42.

Conference Paper | Published | English

No fulltext has been uploaded

Author
;
Editor
Ikei, Yasushi ; Göbel, Martin ; Chen, Jim
Abstract
This paper describes the underlying concepts and the technical implementation of a system for resolving multimodal references in Virtual Reality (VR). In this system the temporal and semantic relations intrinsic to referential utterances are expressed as a constraint satisfaction problem, where the propositional value of each referential unit during a multimodal dialogue updates incrementally the active set of constraints. As the system is based on findings of human cognition research it also regards, e.g., constraints implicitly assumed by human communicators. The implementation takes VR related real-time and immersive conditions into account and adapts its architecture to well known scene-graph based design patterns by introducing a socalled reference resolution engine. Regarding the conceptual work as well as regarding the implementation, special care has been taken to allow further refinements and modifications to the underlying resolving processes on a high level basis.
Publishing Year
PUB-ID

Cite this

Pfeiffer T, Latoschik ME. Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In: Ikei Y, Göbel M, Chen J, eds. Proceedings of the IEEE Virtual Reality 2004. 2004: 35-42.
Pfeiffer, T., & Latoschik, M. E. (2004). Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In Y. Ikei, M. Göbel, & J. Chen (Eds.), Proceedings of the IEEE Virtual Reality 2004 (pp. 35-42).
Pfeiffer, T., and Latoschik, M. E. (2004). “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments” in Proceedings of the IEEE Virtual Reality 2004, ed. Y. Ikei, M. Göbel, and J. Chen 35-42.
Pfeiffer, T., & Latoschik, M.E., 2004. Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In Y. Ikei, M. Göbel, & J. Chen, eds. Proceedings of the IEEE Virtual Reality 2004. pp. 35-42.
T. Pfeiffer and M.E. Latoschik, “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments”, Proceedings of the IEEE Virtual Reality 2004, Y. Ikei, M. Göbel, and J. Chen, eds., 2004, pp.35-42.
Pfeiffer, T., Latoschik, M.E.: Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments. In: Ikei, Y., Göbel, M., and Chen, J. (eds.) Proceedings of the IEEE Virtual Reality 2004. p. 35-42. (2004).
Pfeiffer, Thies, and Latoschik, M. E. “Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments”. Proceedings of the IEEE Virtual Reality 2004. Ed. Yasushi Ikei, Martin Göbel, and Jim Chen. 2004. 35-42.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search