Towards gesture-based literacy training with a virtual agent

Bergmann K (2015)
In: Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication. Jokinen K, Vels M (Eds); Linköping Electronic Conference Proceedings: 113-121.

Download
No fulltext has been uploaded. References only!
Conference Paper | Published | English

No fulltext has been uploaded

Editor
Jokinen, Kristiina ; Vels, Martin
Abstract
Illiteracy remains a persistent problem all over the world. Especially people with cognitive impairments are affected and, at the same time, often excluded from interventions because courses and e-learning materials are not tailored to the particular needs of these people. A teaching method that is occasionally applied in special schools is a gesture-based training: Learning of letter-sound pairs is supported by associated gestures. In this paper first steps towards realizing this methodology with a virtual teacher are presented. We apply a user-centered approach and present a first prototype system which is used to set up an evaluation with learners from the target audience. In the study, participants learned with the system in consecutive learning sessions over three days. We present results with regard to the general acceptability of the system, problems the learners had as well as issues of the system they liked. The outcome of the study serves to inform future versions of the prototype system.
Publishing Year
Conference
2nd European Symposium on Multimodal Communication
Location
Tartu, Estonia
ISSN
PUB-ID

Cite this

Bergmann K. Towards gesture-based literacy training with a virtual agent. In: Jokinen K, Vels M, eds. Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication. Linköping Electronic Conference Proceedings; 2015: 113-121.
Bergmann, K. (2015). Towards gesture-based literacy training with a virtual agent. In K. Jokinen & M. Vels (Eds.), Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication (pp. 113-121). Linköping Electronic Conference Proceedings.
Bergmann, K. (2015). “Towards gesture-based literacy training with a virtual agent” in Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication, Jokinen, K., and Vels, M. eds. (Linköping Electronic Conference Proceedings), 113-121.
Bergmann, K., 2015. Towards gesture-based literacy training with a virtual agent. In K. Jokinen & M. Vels, eds. Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication. Linköping Electronic Conference Proceedings, pp. 113-121.
K. Bergmann, “Towards gesture-based literacy training with a virtual agent”, Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication, K. Jokinen and M. Vels, eds., Linköping Electronic Conference Proceedings, 2015, pp.113-121.
Bergmann, K.: Towards gesture-based literacy training with a virtual agent. In: Jokinen, K. and Vels, M. (eds.) Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication. p. 113-121. Linköping Electronic Conference Proceedings (2015).
Bergmann, Kirsten. “Towards gesture-based literacy training with a virtual agent”. Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication. Ed. Kristiina Jokinen and Martin Vels. Linköping Electronic Conference Proceedings, 2015. 113-121.
This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar