Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations

Hermann T, Neumann A, Schnier C, Pitsch K (2013)
In: AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound. 18:1-18:6.

Download
OA
Conference Paper | Published | English
Abstract
This paper presents and evaluates auditory representations for object interactions as support for cooperating users of an Augmented Reality (AR) system. Particularly head-mounted AR displays limit the field of view and thus cause users to miss relevant activities of their interaction partner, such as object interactions or deictic references that normally would be effective to establish joint attention. We start from an analysis of the differences between face-to-face interaction and interaction via the AR system, using interaction linguistic conversation analysis. From that we derive a set of features that are relevant for interaction partners to co-ordinate their activities. We then present five different interactive sonifications which make object manipulations of interaction partners audible by sonification that convey information about the kind of activity. In this paper we furthermore evaluate our designs in a study where participants observe an interaction episode and rate features of the sonification in questionnaires. In result, we can conclude insights into factors for acceptable sonifications to support dyadic interaction.
Publishing Year
Conference
Audio Mostly 2013
Location
Piteå, Sweden
PUB-ID

Cite this

Hermann T, Neumann A, Schnier C, Pitsch K. Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations. In: AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound. 2013: 18:1-18:6.
Hermann, T., Neumann, A., Schnier, C., & Pitsch, K. (2013). Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations. AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound, 18:1-18:6.
Hermann, T., Neumann, A., Schnier, C., and Pitsch, K. (2013). “Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations” in AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound 18:1-18:6.
Hermann, T., et al., 2013. Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations. In AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound. pp. 18:1-18:6.
T. Hermann, et al., “Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations”, AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound, 2013, pp.18:1-18:6.
Hermann, T., Neumann, A., Schnier, C., Pitsch, K.: Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations. AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound. p. 18:1-18:6. (2013).
Hermann, Thomas, Neumann, Alexander, Schnier, Christian, and Pitsch, Karola. “Sonification for Supporting Joint Attention in Dyadic Augmented Reality-based Cooperations”. AM '13: Proceedings of the 8th Audio Mostly Conference: A Conference on Interaction with Sound. 2013. 18:1-18:6.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2013-11-27 17:54:21

This data publication is cited in the following publications:
This publication cites the following data publications:
Confirmation
Letter of Confirmation

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar
ISBN Search