Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis

Brüning B-A, Schnier C, Pitsch K, Wachsmuth S (2012)
In: Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. Morency L-P (Ed); New York, NY: ACM: 201-208.

Download
No fulltext has been uploaded. References only!
Book Chapter | Published | English

No fulltext has been uploaded

Book Editor
Morency, Louis-Philippe
Abstract
In order to understand and model the non-verbal communicative conduct of humans, it seems fruitful to combine qualitative (Conversation Analysis [6] [10] [11]) and quantitative analytical (motion capturing) methods. Tools for data visualization and annotation are important as they constitute a central interface between different research approaches and methodologies. With this aim we have developed the pre-annotation tool "PAMOCAT - Pre Annotation Motion Capture Analysis Tool" that detects different phenomena. These phenomena are in the category single person and person overlapping phenomena. Included are functions for the analysis of head focused objects, hand activities, single DOF- degree of freedom activity, posture detection and intrusions into the co-participant's space. These detected phenomena related to the frames will be displayed in an overview. The phenomena can be chosen to search for a specific constellation between these different phenomena. A sophisticated user interface easily allows the annotating person to find correlations between different joints and phenomena, to analyze the corresponding 3D pose in a reconstructed virtual environment, and to export combined qualitative and quantitative annotations to standard annotation tools. Using this technique we are able to examine complex setups with three participants engaged in conversation. In this paper we propose how PAMOCAT can be integrated in the research cycle by showing a concrete PAMOCAT-based micro-analysis of a multimodal phenomenon, which deals with kinetic procedures to claim the floor.
Publishing Year
Conference
2012 ACM SIGCHI International Conference on Multimodal Interaction (ICMI '12)
Location
Santa Monica, CA, USA
Conference Date
2012-10-22 – 2012-10-26
PUB-ID

Cite this

Brüning B-A, Schnier C, Pitsch K, Wachsmuth S. Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In: Morency L-P, ed. Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. New York, NY: ACM; 2012: 201-208.
Brüning, B. - A., Schnier, C., Pitsch, K., & Wachsmuth, S. (2012). Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In L. - P. Morency (Ed.), Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction (pp. 201-208). New York, NY: ACM.
Brüning, B. - A., Schnier, C., Pitsch, K., and Wachsmuth, S. (2012). “Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis” in Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction, Morency, L. - P. ed. (New York, NY: ACM), 201-208.
Brüning, B.-A., et al., 2012. Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In L. - P. Morency, ed. Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. New York, NY: ACM, pp. 201-208.
B.-A. Brüning, et al., “Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis”, Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction, L.-P. Morency, ed., New York, NY: ACM, 2012, pp.201-208.
Brüning, B.-A., Schnier, C., Pitsch, K., Wachsmuth, S.: Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In: Morency, L.-P. (ed.) Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. p. 201-208. ACM, New York, NY (2012).
Brüning, Bernhard-Andreas, Schnier, Christian, Pitsch, Karola, and Wachsmuth, Sven. “Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis”. Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. Ed. Louis-Philippe Morency. New York, NY: ACM, 2012. 201-208.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Web of Science

View record in Web of Science®

Search this title in

Google Scholar