Few-shot Keypose Detection for Learning of Psychomotor Skills
Paaßen B, Baumgartner T, Geisen M, Riedl N, Kravčík M (2022)
In: Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022). Asyraaf Mat Sanusi K, Limbu B, Schneider J, Di Mitri D, Klemke R (Eds); 22–27.
Konferenzbeitrag | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Paaßen, BenjaminUniBi 
;
Baumgartner, Tobias;
Geisen, Mai;
Riedl, Nina;
Kravčík, Miloš
;
Baumgartner, Tobias;
Geisen, Mai;
Riedl, Nina;
Kravčík, MilošHerausgeber*in
Asyraaf Mat Sanusi, Khaleel;
Limbu, Bibeg;
Schneider, Jan;
Di Mitri, Daniele;
Klemke, Roland
Einrichtung
Abstract / Bemerkung
Some psychomotor tasks require students to perform a specific sequence of poses and motions. A natural teaching scheme for such tasks is to contrast a student’s execution to a teacher demonstration. However, this requires strategies to match the teacher demonstration of each motion to the student’s attempts and to identify differences between demonstration and attempt. In this paper, we investigate methods to automatically detect student attempts for poses with only a single correct teacher demonstration. We investigate relevance learning, prototype networks, and attention mechanisms to achieve a robust few-shot approach which generalizes across students. In an experiment with one teacher and 27 students performing a sequence of motion elements from the field of fitness and dance, we show that prototype networks combined with an attention mechanism perform best.
Stichworte
psychomotor training;
few-shot learning;
metric learning;
prototype networks;
convolutional neural networks
Erscheinungsjahr
2022
Titel des Konferenzbandes
Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022)
Seite(n)
22–27
Konferenz
Second International Workshop on Multimodal Immersive Learning Systems (MILeS 2022)
Konferenzort
Toulouse, France
Konferenzdatum
2022-09-12 – 2022-09-13
Page URI
https://pub.uni-bielefeld.de/record/2979003
Zitieren
Paaßen B, Baumgartner T, Geisen M, Riedl N, Kravčík M. Few-shot Keypose Detection for Learning of Psychomotor Skills. In: Asyraaf Mat Sanusi K, Limbu B, Schneider J, Di Mitri D, Klemke R, eds. Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022). 2022: 22–27.
Paaßen, B., Baumgartner, T., Geisen, M., Riedl, N., & Kravčík, M. (2022). Few-shot Keypose Detection for Learning of Psychomotor Skills. In K. Asyraaf Mat Sanusi, B. Limbu, J. Schneider, D. Di Mitri, & R. Klemke (Eds.), Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022) (p. 22–27).
Paaßen, Benjamin, Baumgartner, Tobias, Geisen, Mai, Riedl, Nina, and Kravčík, Miloš. 2022. “Few-shot Keypose Detection for Learning of Psychomotor Skills”. In Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022), ed. Khaleel Asyraaf Mat Sanusi, Bibeg Limbu, Jan Schneider, Daniele Di Mitri, and Roland Klemke, 22–27.
Paaßen, B., Baumgartner, T., Geisen, M., Riedl, N., and Kravčík, M. (2022). “Few-shot Keypose Detection for Learning of Psychomotor Skills” in Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022), Asyraaf Mat Sanusi, K., Limbu, B., Schneider, J., Di Mitri, D., and Klemke, R. eds. 22–27.
Paaßen, B., et al., 2022. Few-shot Keypose Detection for Learning of Psychomotor Skills. In K. Asyraaf Mat Sanusi, et al., eds. Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022). pp. 22–27.
B. Paaßen, et al., “Few-shot Keypose Detection for Learning of Psychomotor Skills”, Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022), K. Asyraaf Mat Sanusi, et al., eds., 2022, pp.22–27.
Paaßen, B., Baumgartner, T., Geisen, M., Riedl, N., Kravčík, M.: Few-shot Keypose Detection for Learning of Psychomotor Skills. In: Asyraaf Mat Sanusi, K., Limbu, B., Schneider, J., Di Mitri, D., and Klemke, R. (eds.) Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022). p. 22–27. (2022).
Paaßen, Benjamin, Baumgartner, Tobias, Geisen, Mai, Riedl, Nina, and Kravčík, Miloš. “Few-shot Keypose Detection for Learning of Psychomotor Skills”. Proceedings of the Second International Workshop on Multimodal Immersive Learning Systems ({MILeS} 2022). Ed. Khaleel Asyraaf Mat Sanusi, Bibeg Limbu, Jan Schneider, Daniele Di Mitri, and Roland Klemke. 2022. 22–27.
Open Access
Google Scholar