Using virtual reality technology in linguistic research

Pfeiffer T (2012)
In: Virtual Reality Short Papers and Posters (VRW). Coquillart S, Feiner S, Kiyokawa K (Eds);Institute of Electrical and Electronics Engineers (IEEE): 83-84.

Conference Paper | Published | English

No fulltext has been uploaded

Editor
Coquillart, Sabine ; Feiner, Steven ; Kiyokawa, Kiyoshi
Abstract
In this paper, we argue that empirical research on genuine linguistic topics, such as on the production of multimodal utterances in the speaker and the interpretation of the multimodal signals in the interlocutor, can greatly benefit from the use of virtual reality technologies. Established methodologies for research on multimodal interactions, such as the presentation of pre-recorded 2D videos of interaction partners as stimuli and the recording of interaction partners using multiple 2D video cameras have crucial shortcomings regarding ecological validity and the precision of measurements that can be achieved. In addition, these methodologies enforce restrictions on the researcher. The stimuli, for example, are not very interactive and thus not as close to natural interactions as ultimately desired. Also, the analysis of 2D video recordings requires intensive manual annotations, often frame-by-frame, which negatively affects the feasible number of interactions which can be included in a study. The technologies bundled under the term virtual reality offer exciting possibilities for the linguistic researcher: gestures can be tracked without being restricted to fixed perspectives, annotation can be done on large corpora (semi-)automatically and virtual characters can be used to produce specific linguistic stimuli in a repetitive but interactive fashion. Moreover, immersive 3D visualizations can be used to recreate a simulation of the recorded interactions by fusing the raw data with theoretic models to support an iterative data-driven development of linguistic theories. This paper discusses the potential of virtual reality technologies for linguistic research and provides examples for the application of the methodology.
Publishing Year
Conference
IEEE Virtual Reality 2012
Location
Costa Mesa, CA, USA
Conference Date
2012-03-04 – 2012-03-08
PUB-ID

Cite this

Pfeiffer T. Using virtual reality technology in linguistic research. In: Coquillart S, Feiner S, Kiyokawa K, eds. Virtual Reality Short Papers and Posters (VRW). Institute of Electrical and Electronics Engineers (IEEE); 2012: 83-84.
Pfeiffer, T. (2012). Using virtual reality technology in linguistic research. In S. Coquillart, S. Feiner, & K. Kiyokawa (Eds.), Virtual Reality Short Papers and Posters (VRW) (pp. 83-84). Institute of Electrical and Electronics Engineers (IEEE).
Pfeiffer, T. (2012). “Using virtual reality technology in linguistic research” in Virtual Reality Short Papers and Posters (VRW), ed. S. Coquillart, S. Feiner, and K. Kiyokawa (Institute of Electrical and Electronics Engineers (IEEE), 83-84.
Pfeiffer, T., 2012. Using virtual reality technology in linguistic research. In S. Coquillart, S. Feiner, & K. Kiyokawa, eds. Virtual Reality Short Papers and Posters (VRW). Institute of Electrical and Electronics Engineers (IEEE), pp. 83-84.
T. Pfeiffer, “Using virtual reality technology in linguistic research”, Virtual Reality Short Papers and Posters (VRW), S. Coquillart, S. Feiner, and K. Kiyokawa, eds., Institute of Electrical and Electronics Engineers (IEEE), 2012, pp.83-84.
Pfeiffer, T.: Using virtual reality technology in linguistic research. In: Coquillart, S., Feiner, S., and Kiyokawa, K. (eds.) Virtual Reality Short Papers and Posters (VRW). p. 83-84. Institute of Electrical and Electronics Engineers (IEEE) (2012).
Pfeiffer, Thies. “Using virtual reality technology in linguistic research”. Virtual Reality Short Papers and Posters (VRW). Ed. Sabine Coquillart, Steven Feiner, and Kiyoshi Kiyokawa. Institute of Electrical and Electronics Engineers (IEEE), 2012. 83-84.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search