Supplementary Material for "Head gesture sonification for supporting social interaction"

Hermann T, Neumann A, Zehe S (2012)
Bielefeld University.

Download
OA
OA Sound example S2
OA Video example S3
All
Research Data
Abstract
In this paper we introduce two new methods for real-time sonification of head movements and head gestures. Head gestures such as nodding, shaking the head, etc. are important non-verbal back-channelling signals which facilitate coordination and alignment of communicating interaction partners. Visually impaired persons cannot interpret such non-verbal signals, same as people in mediated communication (e.g. on the phone), or cooperating users whose visual attention is focussed elsewhere. We introduce the idea, the approach, our sensing setup and two different sonification methods. A first preliminary study on the recognition of signals shows that subjects understand gesture type even without prior explanation, and can estimate gesture intensity and frequency with no or little training.
Publishing Year
Data Re-Use License
This Supplementary Material for "Head gesture sonification for supporting social interaction" is made available under the Open Database License: http://opendatacommons.org/licenses/odbl/1.0. Any rights in individual contents of the database are licensed under the Database Contents License: http://opendatacommons.org/licenses/dbcl/1.0/
PUB-ID

Cite this

Hermann T, Neumann A, Zehe S. Supplementary Material for "Head gesture sonification for supporting social interaction". Bielefeld University; 2012.
Hermann, T., Neumann, A., & Zehe, S. (2012). Supplementary Material for "Head gesture sonification for supporting social interaction". Bielefeld University.
Hermann, T., Neumann, A., and Zehe, S. (2012). Supplementary Material for "Head gesture sonification for supporting social interaction". Bielefeld University.
Hermann, T., Neumann, A., & Zehe, S., 2012. Supplementary Material for "Head gesture sonification for supporting social interaction", Bielefeld University.
T. Hermann, A. Neumann, and S. Zehe, Supplementary Material for "Head gesture sonification for supporting social interaction", Bielefeld University, 2012.
Hermann, T., Neumann, A., Zehe, S.: Supplementary Material for "Head gesture sonification for supporting social interaction". Bielefeld University (2012).
Hermann, Thomas, Neumann, Alexander, and Zehe, Sebastian. Supplementary Material for "Head gesture sonification for supporting social interaction". Bielefeld University, 2012.
All files available under the following license(s):
Main File(s)
File Name
File Title
Sound example S1
Description
Continuous excitatory sonification of head gestures of different type, intensity and velocity.
Access Level
OA Open Access
Last Uploaded
2016-03-03T15:08:15Z
File Name
File Title
Sound example S2
Description
Event-based sonification of head gestures of different type, intensity and velocity.
Access Level
OA Open Access
Last Uploaded
2016-03-03T15:08:15Z
File Name
File Title
Video example S3
Description
Interaction video: live demonstration of the sonifications
Access Level
OA Open Access
Last Uploaded
2016-03-03T15:08:15Z
Access Level
OA Open Access
Last Uploaded
2016-03-03T15:08:15Z

This data publication is cited in the following publications:
2532745
Head gesture sonification for supporting social interaction
Hermann T, Neumann A, Zehe S (2012)
In: AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound. Floros A, Zannos I (Eds);New York, NY, USA: ACM: 82-89.
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar