Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis

Brüning B-A, Schnier C, Pitsch K, Wachsmuth S (2012)
In: Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. Morency L-P (Ed); New York, NY: ACM: 201-208.

Sammelwerksbeitrag | Veröffentlicht| Englisch
 
Download
Es wurde kein Volltext hochgeladen. Nur Publikationsnachweis!
Herausgeber*in
Morency, Louis-Philippe
Abstract / Bemerkung
In order to understand and model the non-verbal communicative conduct of humans, it seems fruitful to combine qualitative (Conversation Analysis [6] [10] [11]) and quantitative analytical (motion capturing) methods. Tools for data visualization and annotation are important as they constitute a central interface between different research approaches and methodologies. With this aim we have developed the pre-annotation tool "PAMOCAT - Pre Annotation Motion Capture Analysis Tool" that detects different phenomena. These phenomena are in the category single person and person overlapping phenomena. Included are functions for the analysis of head focused objects, hand activities, single DOF- degree of freedom activity, posture detection and intrusions into the co-participant's space. These detected phenomena related to the frames will be displayed in an overview. The phenomena can be chosen to search for a specific constellation between these different phenomena. A sophisticated user interface easily allows the annotating person to find correlations between different joints and phenomena, to analyze the corresponding 3D pose in a reconstructed virtual environment, and to export combined qualitative and quantitative annotations to standard annotation tools. Using this technique we are able to examine complex setups with three participants engaged in conversation. In this paper we propose how PAMOCAT can be integrated in the research cycle by showing a concrete PAMOCAT-based micro-analysis of a multimodal phenomenon, which deals with kinetic procedures to claim the floor.
Erscheinungsjahr
2012
Buchtitel
Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction
Seite(n)
201-208
Konferenz
2012 ACM SIGCHI International Conference on Multimodal Interaction (ICMI '12)
Konferenzort
Santa Monica, CA, USA
Konferenzdatum
2012-10-22 – 2012-10-26
ISSN
978-1-4503-1467-1
Page URI
https://pub.uni-bielefeld.de/record/2910549

Zitieren

Brüning B-A, Schnier C, Pitsch K, Wachsmuth S. Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In: Morency L-P, ed. Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. New York, NY: ACM; 2012: 201-208.
Brüning, B. - A., Schnier, C., Pitsch, K., & Wachsmuth, S. (2012). Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In L. - P. Morency (Ed.), Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction (pp. 201-208). New York, NY: ACM.
Brüning, B. - A., Schnier, C., Pitsch, K., and Wachsmuth, S. (2012). “Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis” in Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction, Morency, L. - P. ed. (New York, NY: ACM), 201-208.
Brüning, B.-A., et al., 2012. Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In L. - P. Morency, ed. Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. New York, NY: ACM, pp. 201-208.
B.-A. Brüning, et al., “Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis”, Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction, L.-P. Morency, ed., New York, NY: ACM, 2012, pp.201-208.
Brüning, B.-A., Schnier, C., Pitsch, K., Wachsmuth, S.: Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis. In: Morency, L.-P. (ed.) Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. p. 201-208. ACM, New York, NY (2012).
Brüning, Bernhard-Andreas, Schnier, Christian, Pitsch, Karola, and Wachsmuth, Sven. “Integrating PAMOCAT in the research cycle: linking motion capturing and conversation analysis”. Proceedings of 2012 ACM SIGCHI International Conference on Multimodal Interaction. Ed. Louis-Philippe Morency. New York, NY: ACM, 2012. 201-208.