An Embodied Tutoring System for Literal vs. Metaphorical Concepts

In this paper we combine motion captured data with linguistic notions (preliminary study) in a game-like tutoring system (study 1), in order to help elementary school students to better differentiate literal from metaphorical uses of motion verbs, based on embodied information. In addition to the thematic goal, we intend to improve young students’ attention and spatiotemporal memory, by presenting sensorimotor data experimentally collected from thirty two participants in our motion capturing labs. Furthermore, we examine the accomplishment of tutor’s goals and compare them to curriculum’s approach (study 2). Sixty nine elementary school students were randomly divided in two experimental groups (game-like and traditional) and one control group, which did not undergo an intervention. All groups were tested in pre and post-tests. Even though the diagnostic pretests present a uniform picture, two way analysis of variance suggests that the experimental groups showed progress in post-tests and, more specifically, game-like group showed less wrong answers in the linguistics task and higher learning achievements compared to the other two groups. Furthermore, in the game-like condition the participants needed gradually shorter period of time to identify the avatar’s actions. This finding was considered as a first indication of attentional and spatiotemporal memory’s improvement, while the tutor’s assistance features cultivated students’ metacognitive perception.

[1]  D. Keltner,et al.  Functional Accounts of Emotions , 1999 .

[2]  Z. Kövecses,et al.  Where Metaphors Come From: Reconsidering Context in Metaphor , 2015 .

[3]  Anjan Chatterjee,et al.  From novel to familiar: Tuning the brain for metaphors , 2012, NeuroImage.

[4]  G. Hanley e‐Learning and the Science of Instruction , 2004 .

[5]  Jaime R. Carbonell,et al.  AI in CAI : An artificial intelligence approach to computer-assisted instruction , 1970 .

[6]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[7]  Richard E. Mayer,et al.  e-Learning and the Science of Instruction , 2016 .

[8]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[9]  Claudia Adams,et al.  The use of computer games as an educational tool: identification of appropriate game types and game elements , 1999, Br. J. Educ. Technol..

[10]  A. Chatterjee Disembodying cognition , 2010, Language and Cognition.

[11]  T. Schack Measuring Mental Representations , 2012 .

[12]  Jim Bizzocchi,et al.  Game, Motivation, and Effective Learning: An Integrated Model for Educational Game Design , 2005, DiGRA Conference.

[13]  S. Vosniadou Children and Metaphors. , 1987 .

[14]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[15]  Vincent Aleven,et al.  Limitations of Student Control: Do Students Know When They Need Help? , 2000, Intelligent Tutoring Systems.

[16]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[17]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[18]  Scott DeLoach,et al.  Learning from Games: Seven Principles of Effective Design , 1998 .

[19]  Jean M. Mandler,et al.  On the Spatial Foundations of the Conceptual System and Its Enrichment , 2012, Cogn. Sci..

[20]  H. Barnes Learning That Grows with the Learner: An Introduction to Waldorf Education. , 1991 .

[21]  Kenneth R. Koedinger,et al.  When Is Assistance Helpful to Learning? Results in Combining Worked Examples and Intelligent Tutoring , 2008, Intelligent Tutoring Systems.

[22]  F. Pulvermüller,et al.  Grasping Ideas with the Motor System: Semantic Somatotopy in Idiom Comprehension , 2009 .

[23]  Erik Kaestner,et al.  The Foundations Of Mind Origins Of Conceptual Thought , 2016 .

[24]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[25]  Anja Jamrozik,et al.  Metaphor: Bridging embodiment to abstraction , 2016, Psychonomic Bulletin & Review.

[26]  S Frost,et al.  Louder than words. , 1998, Nursing times.

[27]  Elena L Grigorenko,et al.  Dynamic Assessment and Response to Intervention , 2009, Journal of learning disabilities.

[28]  Georgi Stojanov,et al.  Embodiment as metaphor: metaphorizing- in the environment , 1999 .

[29]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[30]  Marina Pavlova,et al.  Biological Motion Shown Backwards: The Apparent-Facing Effect , 2002, Perception.

[31]  L. Vygotsky Interaction between learning and development , 1978 .

[32]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[33]  L. Boroditsky Metaphoric structuring: understanding time through spatial metaphors , 2000, Cognition.

[34]  Lera Boroditsky,et al.  The Roles of Body and Mind in Abstract Thought , 2002, Psychological science.

[35]  J. Feldman,et al.  Karma: knowledge-based active representations for metaphor and aspect , 1997 .

[36]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[37]  Jean M. Mandler,et al.  The spatial foundations of the conceptual system , 2010, Language and Cognition.

[38]  Jean M. Mandler,et al.  On defining image schemas , 2014, Language and Cognition.

[39]  M. Shiffrar,et al.  Subconfigurations of the human form in the perception of biological motion displays. , 1999, Acta psychologica.

[40]  Beverly Park Woolf,et al.  Building Intelligent Interactive Tutors: Student-centered Strategies for Revolutionizing E-learning , 2008 .

[41]  Marina Papastergiou,et al.  The impact of an exergame-based intervention on children's fundamental motor skills , 2015, Comput. Educ..

[42]  N. Troje,et al.  Person identification from biological motion: Effects of structural and kinematic cues , 2005, Perception & psychophysics.

[43]  Tom Murray,et al.  An Overview of Intelligent Tutoring System Authoring Tools: Updated Analysis of the State of the Art , 2003 .

[44]  Randall Stilla,et al.  Metaphorically feeling: Comprehending textural metaphors activates somatosensory cortex , 2012, Brain and Language.

[45]  T. Talavage,et al.  Neuroanatomical distribution of five semantic components of verbs: Evidence from fMRI , 2008, Brain and Language.

[46]  Nikolaus F Troje,et al.  Reference Frames for Orientation Anisotropies in Face Recognition and Biological-Motion Perception , 2003, Perception.

[47]  Mark L. Johnson The body in the mind: the bodily basis of meaning , 1987 .

[48]  Reva Freedman Plan-Based Dialogue Management in a Physics Tutor , 2000, ANLP.

[49]  Jacqueline Bourdeau,et al.  Advances in Intelligent Tutoring Systems , 2010 .

[50]  Developmental Relationships Between Psychological Metaphors and Concepts of Life and Consciousness , 1991 .

[51]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[52]  Tom Routen,et al.  Intelligent Tutoring Systems , 1996, Lecture Notes in Computer Science.

[53]  Adrian Akmajian,et al.  Linguistics: An Introduction to Language and Communication , 1979 .

[54]  Karl Verfaillie,et al.  Perception of biological motion: A stimulus set of human point-light actions , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.