Head gesture sonification for supporting social interaction

Hermann T, Neumann A, Zehe S (2012)
In: AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound. Floros A, Zannos I (Eds);New York, NY, USA: ACM: 82-89.

Download
OA
Conference Paper | Published | English
Editor
Floros, Andreas ; Zannos, Iani
Abstract
In this paper we introduce two new methods for real-time sonification of head movements and head gestures. Head gestures such as nodding or shaking the head are important non-verbal back-channelling signals which facilitate coordination and alignment of communicating interaction partners. Visually impaired persons cannot interpret such non-verbal signals, same as people in mediated communication (e.g. on the phone), or cooperating users whose visual attention is focused elsewhere. We introduce our approach to tackle these issues, our sensing setup and two different sonification methods. A first preliminary study on the recognition of signals shows that subjects understand the gesture type even without prior explanation and can estimate gesture intensity and frequency with no or little training.
Publishing Year
Conference
Audio Mostly 2012
Location
Corfu, Greece
Conference Date
2012-09-26
PUB-ID

Cite this

Hermann T, Neumann A, Zehe S. Head gesture sonification for supporting social interaction. In: Floros A, Zannos I, eds. AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound. New York, NY, USA: ACM; 2012: 82-89.
Hermann, T., Neumann, A., & Zehe, S. (2012). Head gesture sonification for supporting social interaction. In A. Floros & I. Zannos (Eds.), AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound (pp. 82-89). New York, NY, USA: ACM. doi:10.1145/2371456.2371469
Hermann, T., Neumann, A., and Zehe, S. (2012). “Head gesture sonification for supporting social interaction” in AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound, ed. A. Floros and I. Zannos (New York, NY, USA: ACM), 82-89.
Hermann, T., Neumann, A., & Zehe, S., 2012. Head gesture sonification for supporting social interaction. In A. Floros & I. Zannos, eds. AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound. New York, NY, USA: ACM, pp. 82-89.
T. Hermann, A. Neumann, and S. Zehe, “Head gesture sonification for supporting social interaction”, AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound, A. Floros and I. Zannos, eds., New York, NY, USA: ACM, 2012, pp.82-89.
Hermann, T., Neumann, A., Zehe, S.: Head gesture sonification for supporting social interaction. In: Floros, A. and Zannos, I. (eds.) AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound. p. 82-89. ACM, New York, NY, USA (2012).
Hermann, Thomas, Neumann, Alexander, and Zehe, Sebastian. “Head gesture sonification for supporting social interaction”. AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound. Ed. Andreas Floros and Iani Zannos. New York, NY, USA: ACM, 2012. 82-89.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2014-11-27 16:57:43

This data publication is cited in the following publications:
This publication cites the following data publications:
2695833
Supplementary Material for "Head gesture sonification for supporting social interaction"
Hermann T, Neumann A, Zehe S (2012)
Bielefeld University.
External material:
Supplementary Material
Description
sonification examples and interaction video

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search