Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention

Neumann A, Hermann T (2013)
In: Proceedings of the 19th International Conference on Auditory Displays. Strumiłło P, Bujacz M, Popielata M (Eds);The International Community for Auditory Display (ICAD): 49-55.

Download
OA
Conference Paper | Published | English
Editor
Strumiłło, Paweł ; Bujacz, Michał ; Popielata, Monika
Abstract
This paper introduces a novel sonification-based interaction support for cooperating users in an Augmented Reality setting. When using head-mounted AR displays, the field of view is limited which causes users to miss important activities such as object interactions or deictic references of their interaction partner to (re-)establish joint attention. We introduce an interactive sonification which makes object manipulations of both interaction partners mutually transparent by sounds that convey information about the kind of activity, and which can optionally even identify the object itself. In this paper we focus on the sonification method, interaction design and sound design, and we furthermore render the sonification both from sensor data (e.g. object tracking) and manual annotations. As a spin-off of our approach we propose this method further for the enhancement of interaction observation, data analysis, and multimodal annotation in interactional linguistics and conversation analysis.
Publishing Year
Conference
International Conference on Auditory Display (ICAD 2013)
Location
Lodz, Poland
Conference Date
2013-07-06 – 2013-07-10
PUB-ID

Cite this

Neumann A, Hermann T. Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention. In: Strumiłło P, Bujacz M, Popielata M, eds. Proceedings of the 19th International Conference on Auditory Displays. The International Community for Auditory Display (ICAD); 2013: 49-55.
Neumann, A., & Hermann, T. (2013). Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention. In P. Strumiłło, M. Bujacz, & M. Popielata (Eds.), Proceedings of the 19th International Conference on Auditory Displays (pp. 49-55). The International Community for Auditory Display (ICAD).
Neumann, A., and Hermann, T. (2013). “Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention” in Proceedings of the 19th International Conference on Auditory Displays, ed. P. Strumiłło, M. Bujacz, and M. Popielata (The International Community for Auditory Display (ICAD), 49-55.
Neumann, A., & Hermann, T., 2013. Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention. In P. Strumiłło, M. Bujacz, & M. Popielata, eds. Proceedings of the 19th International Conference on Auditory Displays. The International Community for Auditory Display (ICAD), pp. 49-55.
A. Neumann and T. Hermann, “Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention”, Proceedings of the 19th International Conference on Auditory Displays, P. Strumiłło, M. Bujacz, and M. Popielata, eds., The International Community for Auditory Display (ICAD), 2013, pp.49-55.
Neumann, A., Hermann, T.: Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention. In: Strumiłło, P., Bujacz, M., and Popielata, M. (eds.) Proceedings of the 19th International Conference on Auditory Displays. p. 49-55. The International Community for Auditory Display (ICAD) (2013).
Neumann, Alexander, and Hermann, Thomas. “Interactive Sonification of Collaborative AR-based Planning Tasks for Enhancing Joint Attention”. Proceedings of the 19th International Conference on Auditory Displays. Ed. Paweł Strumiłło, Michał Bujacz, and Monika Popielata. The International Community for Auditory Display (ICAD), 2013. 49-55.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2013-11-27 18:08:53

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search