An Embodied Tutoring System for Literal vs. Metaphorical Concepts
Sionti M, Schack T, Aloimonos Y (2018)
FRONTIERS IN PSYCHOLOGY 9: 2254.
Zeitschriftenaufsatz
| Veröffentlicht | Englisch
Download
fpsyg-09-02254 (2).sionti.pdf
1.57 MB
Autor*in
Einrichtung
Abstract / Bemerkung
In this paper we combine motion captured data with linguistic notions (preliminary study) in a game-like tutoring system (study 1), in order to help elementary school students to better differentiate literal from metaphorical uses of motion verbs, based on embodied information. In addition to the thematic goal, we intend to improve young students' attention and spatiotemporal memory, by presenting sensorimotor data experimentally collected from thirty two participants in our motion capturing labs. Furthermore, we examine the accomplishment of tutor's goals and compare them to curriculum's approach (study 2). Sixty nine elementary school students were randomly divided in two experimental groups (game-like and traditional) and one control group, which did not undergo an intervention. All groups were tested in pre and post-tests. Even though the diagnostic pretests present a uniform picture, two way analysis of variance suggests that the experimental groups showed progress in post-tests and, more specifically, game-like group showed less wrong answers in the linguistics task and higher learning achievements compared to the other two groups. Furthermore, in the game-like condition the participants needed gradually shorter period of time to identify the avatar's actions. This finding was considered as a first indication of attentional and spatiotemporal memory's improvement, while the tutor's assistance features cultivated students' metacognitive perception.
Stichworte
motion capture data;
educational (serious) game;
literal meaning;
metaphors;
language teaching;
spatiotemporal memory
Erscheinungsjahr
2018
Zeitschriftentitel
FRONTIERS IN PSYCHOLOGY
Band
9
Art.-Nr.
2254
ISSN
1664-1078
Finanzierungs-Informationen
Open-Access-Publikationskosten wurden durch die Deutsche Forschungsgemeinschaft und die Universität Bielefeld gefördert.
Page URI
https://pub.uni-bielefeld.de/record/2932763
Zitieren
Sionti M, Schack T, Aloimonos Y. An Embodied Tutoring System for Literal vs. Metaphorical Concepts. FRONTIERS IN PSYCHOLOGY. 2018;9: 2254.
Sionti, M., Schack, T., & Aloimonos, Y. (2018). An Embodied Tutoring System for Literal vs. Metaphorical Concepts. FRONTIERS IN PSYCHOLOGY, 9, 2254. doi:10.3389/fpsyg.2018.02254
Sionti, Marietta, Schack, Thomas, and Aloimonos, Yiannis. 2018. “An Embodied Tutoring System for Literal vs. Metaphorical Concepts”. FRONTIERS IN PSYCHOLOGY 9: 2254.
Sionti, M., Schack, T., and Aloimonos, Y. (2018). An Embodied Tutoring System for Literal vs. Metaphorical Concepts. FRONTIERS IN PSYCHOLOGY 9:2254.
Sionti, M., Schack, T., & Aloimonos, Y., 2018. An Embodied Tutoring System for Literal vs. Metaphorical Concepts. FRONTIERS IN PSYCHOLOGY, 9: 2254.
M. Sionti, T. Schack, and Y. Aloimonos, “An Embodied Tutoring System for Literal vs. Metaphorical Concepts”, FRONTIERS IN PSYCHOLOGY, vol. 9, 2018, : 2254.
Sionti, M., Schack, T., Aloimonos, Y.: An Embodied Tutoring System for Literal vs. Metaphorical Concepts. FRONTIERS IN PSYCHOLOGY. 9, : 2254 (2018).
Sionti, Marietta, Schack, Thomas, and Aloimonos, Yiannis. “An Embodied Tutoring System for Literal vs. Metaphorical Concepts”. FRONTIERS IN PSYCHOLOGY 9 (2018): 2254.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Copyright Statement:
Dieses Objekt ist durch das Urheberrecht und/oder verwandte Schutzrechte geschützt. [...]
Volltext(e)
Name
fpsyg-09-02254 (2).sionti.pdf
1.57 MB
Access Level
Open Access
Zuletzt Hochgeladen
2019-09-06T09:19:04Z
MD5 Prüfsumme
f072d3a8417bd8a95399ec0d548bfddd
Daten bereitgestellt von European Bioinformatics Institute (EBI)
Zitationen in Europe PMC
Daten bereitgestellt von Europe PubMed Central.
42 References
Daten bereitgestellt von Europe PubMed Central.
Grasping ideas with the motor system: semantic somatotopy in idiom comprehension.
Boulenger V, Hauk O, Pulvermuller F., Cereb. Cortex 19(8), 2008
PMID: 19068489
Boulenger V, Hauk O, Pulvermuller F., Cereb. Cortex 19(8), 2008
PMID: 19068489
The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge.
Gallese V, Lakoff G., Cogn Neuropsychol 22(3), 2005
PMID: 21038261
Gallese V, Lakoff G., Cogn Neuropsychol 22(3), 2005
PMID: 21038261
The roles of body and mind in abstract thought.
Boroditsky L, Ramscar M., Psychol Sci 13(2), 2002
PMID: 11934006
Boroditsky L, Ramscar M., Psychol Sci 13(2), 2002
PMID: 11934006
Reference frames for orientation anisotropies in face recognition and biological-motion perception.
Troje NF., Perception 32(2), 2003
PMID: 12696665
Troje NF., Perception 32(2), 2003
PMID: 12696665
Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI.
Kemmerer D, Castillo JG, Talavage T, Patterson S, Wiley C., Brain Lang 107(1), 2007
PMID: 17977592
Kemmerer D, Castillo JG, Talavage T, Patterson S, Wiley C., Brain Lang 107(1), 2007
PMID: 17977592
Perception of biological motion: a stimulus set of human point-light actions.
Vanrie J, Verfaillie K., Behav Res Methods Instrum Comput 36(4), 2004
PMID: 15641407
Vanrie J, Verfaillie K., Behav Res Methods Instrum Comput 36(4), 2004
PMID: 15641407
Metaphoric structuring: understanding time through spatial metaphors.
Boroditsky L., Cognition 75(1), 2000
PMID: 10815775
Boroditsky L., Cognition 75(1), 2000
PMID: 10815775
Subconfigurations of the human form in the perception of biological motion displays.
Pinto J, Shiffrar M., Acta Psychol (Amst) 102(2-3), 1999
PMID: 10504885
Pinto J, Shiffrar M., Acta Psychol (Amst) 102(2-3), 1999
PMID: 10504885
Person identification from biological motion: effects of structural and kinematic cues.
Troje NF, Westhoff C, Lavrov M., Percept Psychophys 67(4), 2005
PMID: 16134460
Troje NF, Westhoff C, Lavrov M., Percept Psychophys 67(4), 2005
PMID: 16134460
Dynamic assessment and response to intervention: two sides of one coin.
Grigorenko EL., J Learn Disabil 42(2), 2008
PMID: 19073895
Grigorenko EL., J Learn Disabil 42(2), 2008
PMID: 19073895
Embodied language: a review of the role of the motor system in language comprehension.
Fischer MH, Zwaan RA., Q J Exp Psychol (Hove) 61(6), 2008
PMID: 18470815
Fischer MH, Zwaan RA., Q J Exp Psychol (Hove) 61(6), 2008
PMID: 18470815
Metaphorically feeling: comprehending textural metaphors activates somatosensory cortex.
Lacey S, Stilla R, Sathian K., Brain Lang 120(3), 2012
PMID: 22305051
Lacey S, Stilla R, Sathian K., Brain Lang 120(3), 2012
PMID: 22305051
Premotor cortex and the recognition of motor actions.
Rizzolatti G, Fadiga L, Gallese V, Fogassi L., Brain Res Cogn Brain Res 3(2), 1996
PMID: 8713554
Rizzolatti G, Fadiga L, Gallese V, Fogassi L., Brain Res Cogn Brain Res 3(2), 1996
PMID: 8713554
Biological motion shown backwards: the apparent-facing effect.
Pavlova M, Krageloh-Mann I, Birbaumer N, Sokolov A., Perception 31(4), 2002
PMID: 12018789
Pavlova M, Krageloh-Mann I, Birbaumer N, Sokolov A., Perception 31(4), 2002
PMID: 12018789
Somatotopic representation of action words in human motor and premotor cortex.
Hauk O, Johnsrude I, Pulvermuller F., Neuron 41(2), 2004
PMID: 14741110
Hauk O, Johnsrude I, Pulvermuller F., Neuron 41(2), 2004
PMID: 14741110
Metaphor: Bridging embodiment to abstraction.
Jamrozik A, McQuire M, Cardillo ER, Chatterjee A., Psychon Bull Rev 23(4), 2016
PMID: 27294425
Jamrozik A, McQuire M, Cardillo ER, Chatterjee A., Psychon Bull Rev 23(4), 2016
PMID: 27294425
On the spatial foundations of the conceptual system and its enrichment.
Mandler JM., Cogn Sci 36(3), 2012
PMID: 22435402
Mandler JM., Cogn Sci 36(3), 2012
PMID: 22435402
From novel to familiar: tuning the brain for metaphors.
Cardillo ER, Watson CE, Schmidt GL, Kranjec A, Chatterjee A., Neuroimage 59(4), 2011
PMID: 22155328
Cardillo ER, Watson CE, Schmidt GL, Kranjec A, Chatterjee A., Neuroimage 59(4), 2011
PMID: 22155328
Grasping ideas with the motor system: semantic somatotopy in idiom comprehension.
Boulenger V, Hauk O, Pulvermuller F., Cereb. Cortex 19(8), 2008
PMID: 19068489
Boulenger V, Hauk O, Pulvermuller F., Cereb. Cortex 19(8), 2008
PMID: 19068489
The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge.
Gallese V, Lakoff G., Cogn Neuropsychol 22(3), 2005
PMID: 21038261
Gallese V, Lakoff G., Cogn Neuropsychol 22(3), 2005
PMID: 21038261
The roles of body and mind in abstract thought.
Boroditsky L, Ramscar M., Psychol Sci 13(2), 2002
PMID: 11934006
Boroditsky L, Ramscar M., Psychol Sci 13(2), 2002
PMID: 11934006
Reference frames for orientation anisotropies in face recognition and biological-motion perception.
Troje NF., Perception 32(2), 2003
PMID: 12696665
Troje NF., Perception 32(2), 2003
PMID: 12696665
Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI.
Kemmerer D, Castillo JG, Talavage T, Patterson S, Wiley C., Brain Lang 107(1), 2007
PMID: 17977592
Kemmerer D, Castillo JG, Talavage T, Patterson S, Wiley C., Brain Lang 107(1), 2007
PMID: 17977592
Perception of biological motion: a stimulus set of human point-light actions.
Vanrie J, Verfaillie K., Behav Res Methods Instrum Comput 36(4), 2004
PMID: 15641407
Vanrie J, Verfaillie K., Behav Res Methods Instrum Comput 36(4), 2004
PMID: 15641407
Metaphoric structuring: understanding time through spatial metaphors.
Boroditsky L., Cognition 75(1), 2000
PMID: 10815775
Boroditsky L., Cognition 75(1), 2000
PMID: 10815775
Subconfigurations of the human form in the perception of biological motion displays.
Pinto J, Shiffrar M., Acta Psychol (Amst) 102(2-3), 1999
PMID: 10504885
Pinto J, Shiffrar M., Acta Psychol (Amst) 102(2-3), 1999
PMID: 10504885
Person identification from biological motion: effects of structural and kinematic cues.
Troje NF, Westhoff C, Lavrov M., Percept Psychophys 67(4), 2005
PMID: 16134460
Troje NF, Westhoff C, Lavrov M., Percept Psychophys 67(4), 2005
PMID: 16134460
Dynamic assessment and response to intervention: two sides of one coin.
Grigorenko EL., J Learn Disabil 42(2), 2008
PMID: 19073895
Grigorenko EL., J Learn Disabil 42(2), 2008
PMID: 19073895
Embodied language: a review of the role of the motor system in language comprehension.
Fischer MH, Zwaan RA., Q J Exp Psychol (Hove) 61(6), 2008
PMID: 18470815
Fischer MH, Zwaan RA., Q J Exp Psychol (Hove) 61(6), 2008
PMID: 18470815
Metaphorically feeling: comprehending textural metaphors activates somatosensory cortex.
Lacey S, Stilla R, Sathian K., Brain Lang 120(3), 2012
PMID: 22305051
Lacey S, Stilla R, Sathian K., Brain Lang 120(3), 2012
PMID: 22305051
Premotor cortex and the recognition of motor actions.
Rizzolatti G, Fadiga L, Gallese V, Fogassi L., Brain Res Cogn Brain Res 3(2), 1996
PMID: 8713554
Rizzolatti G, Fadiga L, Gallese V, Fogassi L., Brain Res Cogn Brain Res 3(2), 1996
PMID: 8713554
Biological motion shown backwards: the apparent-facing effect.
Pavlova M, Krageloh-Mann I, Birbaumer N, Sokolov A., Perception 31(4), 2002
PMID: 12018789
Pavlova M, Krageloh-Mann I, Birbaumer N, Sokolov A., Perception 31(4), 2002
PMID: 12018789
Somatotopic representation of action words in human motor and premotor cortex.
Hauk O, Johnsrude I, Pulvermuller F., Neuron 41(2), 2004
PMID: 14741110
Hauk O, Johnsrude I, Pulvermuller F., Neuron 41(2), 2004
PMID: 14741110
Metaphor: Bridging embodiment to abstraction.
Jamrozik A, McQuire M, Cardillo ER, Chatterjee A., Psychon Bull Rev 23(4), 2016
PMID: 27294425
Jamrozik A, McQuire M, Cardillo ER, Chatterjee A., Psychon Bull Rev 23(4), 2016
PMID: 27294425
On the spatial foundations of the conceptual system and its enrichment.
Mandler JM., Cogn Sci 36(3), 2012
PMID: 22435402
Mandler JM., Cogn Sci 36(3), 2012
PMID: 22435402
From novel to familiar: tuning the brain for metaphors.
Cardillo ER, Watson CE, Schmidt GL, Kranjec A, Chatterjee A., Neuroimage 59(4), 2011
PMID: 22155328
Cardillo ER, Watson CE, Schmidt GL, Kranjec A, Chatterjee A., Neuroimage 59(4), 2011
PMID: 22155328
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Quellen
PMID: 30546328
PubMed | Europe PMC
Suchen in