Learning of Abstract Concepts through Full-Body Interaction: A Systematic Review

Over the past ten years several learning environments based on novel interaction modalities have been developed. Within this field, Full-body Interaction Learning Environments open promising possibilities given their capacity to involve the users at different levels, such as sensorimotor experience, cognitive aspects and affective factors. However, Full-body Interaction is still a young field and research on design and assessment methods offers a fragmented panorama from which it is not possible to derive clear research solutions. Starting from this necessity, we present a systematic review of educational applications developed as Full-body Interaction and the results of their empirical evaluation. Our analysis offers instruments to systematize the multiple aspects involved in the design and assessment of Full-body Interaction Learning Environments and provides guidelines for novel research paths.

[1]  Laura Malinverni,et al.  Impact of embodied interaction on learning processes: design and analysis of an educational application based on physical activity , 2012, IDC '12.

[2]  Paul Mulholland,et al.  Whole Body Interaction in Abstract Domains , 2011, Whole Body Interaction.

[3]  Robb Lindgren,et al.  Supporting children's learning with body-based metaphors in a mixed reality environment , 2011, IDC.

[4]  Davide Rocchesso,et al.  Paper mechanisms for sonic interaction , 2012, TEI.

[5]  V. Shute.  SteAlth ASSeSSment in computer-BASed GAmeS to Support leArninG , 2011 .

[6]  Ruth Aylett,et al.  Technology-enhanced role-play for social and emotional learning context - Intercultural empathy , 2011, Entertain. Comput..

[7]  David Birchfield,et al.  Games for learning in embodied mixed-reality environments: principles and results , 2011 .

[8]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .

[9]  Kristian Kiili,et al.  Exerbraining for Schools: Combining Body and Brain Training , 2012, VS-GAMES.

[10]  Mike Sharples,et al.  An evaluation of multimodal interactions with technology while learning science concepts , 2011, Br. J. Educ. Technol..

[11]  Sara Price,et al.  A multimodal approach to examining 'embodiment' in tangible learning environments , 2013, TEI '13.

[12]  G. Lakoff,et al.  The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge , 2005, Cognitive neuropsychology.

[13]  G. Lakoff,et al.  Where mathematics comes from : how the embodied mind brings mathematics into being , 2002 .

[14]  Susan Goldin-Meadow,et al.  Learning through gesture. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[15]  D. Krathwohl.  A Revision of Bloom's Taxonomy: An Overview , 2002 .

[16]  Justine Cassell.  Proceedings of the 7th international conference on Interaction design and children , 2008, IDC 2008.

[17]  Darren Edge,et al.  SpatialEase: learning language through body motion , 2013, CHI.

[18]  A. Kramer,et al.  Be smart, exercise your heart: exercise effects on brain and cognition , 2008, Nature Reviews Neuroscience.

[19]  E. D. Paolo,et al.  Enaction: Toward a New Paradigm for Cognitive Science , 2010 .

[20]  R. Kozma.  Will media influence learning? Reframing the debate , 1994 .

[21]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[22]  Glenda Revelle,et al.  Applying developmental theory and research to the creation of educational games. , 2013, New directions for child and adolescent development.

[23]  Denise D. Bielby,et al.  The Body, Dance, and Cultural Theory , 2005 .

[24]  Yvonne Rogers,et al.  Running up Blueberry Hill: prototyping whole body interaction in harmony space , 2009, Tangible and Embedded Interaction.

[25]  Craig A. Berg,et al.  Assessing Students' Abilities to Construct and Interpret Line Graphs: Disparities between Multiple-Choice and Free-Response Instruments , 1994 .

[26]  E. Ackermann.  Piaget ’ s Constructivism , Papert ’ s Constructionism : What ’ s the difference ? , 2001 .

[27]  Anja Hashagen,et al.  Learning abstract concepts through bodily engagement: a comparative, qualitative study , 2009, IDC.

[28]  M. Rohde,et al.  Horizons for the Enactive Mind: Values, Social Interaction, and Play , 2010 .

[29]  Paul Dourish,et al.  Where the action is , 2001 .

[30]  Noel Enyedy,et al.  Learning physics through play in an augmented reality environment , 2012, Int. J. Comput. Support. Collab. Learn..

[31]  Ulrike Cress,et al.  The use of a digital dance mat for training kindergarten children in a magnitude comparison task , 2010, ICLS.

[32]  M. Johnson-Glenberg,et al.  Semi-virtual Embodied Learning-Real World STEM Assessment , 2011 .

[33]  Anna Carreras,et al.  Generating meaning through interaction in a refreshing interactive water installation for children , 2005 .

[34]  Maria Adler,et al.  Enaction Toward A New Paradigm For Cognitive Science , 2016 .

[35]  Stuart Watt,et al.  Syntonicity and the psychology of programming , 1998, PPIG.

[36]  Kaj Grønbæk,et al.  Interactive Floor Support for Kinesthetic Interaction in Children Learning Environments , 2007, INTERACT.

[37]  Pierre Dillenbourg,et al.  The Evolution of Research on Computer-Supported Collaborative Learning , 2009 .

[38]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[39]  Nadia Bianchi-Berthouze,et al.  Understanding the Role of Body Movement in Player Engagement , 2012, Hum. Comput. Interact..

[40]  E.,et al.  GROUPS : INTERACTION AND PERFORMANCE , 2001 .

[41]  T. V. Leeuwen.  Introducing Social Semiotics: An Introductory Textbook , 2004 .

[42]  Arjun Nagendran,et al.  From the Proceedings for the Games Learning and Society Conference 2012 , symposium on Serious Games in Embodied Mixed Reality Learning Environments , 2012 .

[43]  Leilah Lyons,et al.  Don't forget about the sweat: effortful embodied interaction in support of learning , 2012, TEI.

[44]  Maria Roussou,et al.  Exploring rules and underlying concepts while engaged with collaborative full-body games , 2010, IDC.

[45]  Narcís Parés,et al.  Designing an Interactive Installation for Children to Experience Abstract Concepts , 2007, Interacción.

[46]  David England,et al.  Whole body interaction , 2009, Human-Computer Interaction Series.

[47]  Alissa N. Antle,et al.  Research opportunities: Embodied child-computer interaction , 2013, Int. J. Child Comput. Interact..

[48]  Barbara Mazzarino,et al.  BeSound: embodied reflexion for music education in childhood , 2012, IDC '12.

[49]  Arthur F. Kramer,et al.  The Influence of Childhood Aerobic Fitness on Learning and Memory , 2013, PloS one.

[50]  Gwo-Dong Chen,et al.  Wristbands as Interaction Devices: a Vision-Based Interaction Space for Facilitating Full-Body Learning , 2006, 2006 Fourth IEEE International Workshop on Wireless, Mobile and Ubiquitous Technology in Education (WMTE'06).

[51]  C. Hillman,et al.  Physical fitness and academic achievement in third- and fifth-grade students. , 2007, Journal of sport & exercise psychology.

[52]  Adolfo Perinat Maceres,et al.  Psicología del desarrollo: un enfoque sistémico , 2003 .

[53]  N. Presmeg.  The body in the mind: The bodily basis of meaning, imagination and reason , 1992 .

[54]  Kimiko Ryokai,et al.  The choreography of conceptual development in computer supported instructional environments , 2012, IDC '12.

[55]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[56]  N. Newcombe.  Picture This: Increasing Math and Science Learning by Improving Spatial Thinking. , 2010 .

[57]  Shing-Tsaan Huang,et al.  The Effects of Using Embodied Interactions to Improve Learning Performance , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[58]  Greg Corness,et al.  Balancing justice: comparing whole body and controller-based interaction for an abstract domain , 2013, Int. J. Arts Technol..

[59]  S. Goldin-Meadow,et al.  Making children gesture brings out implicit knowledge and leads to learning. , 2007, Journal of experimental psychology. General.

[60]  Chronis Kynigos,et al.  Interactive Movement and Talk in Generating Meanings from Science , 2012 .

[61]  Dor Abrahamson,et al.  The mathematical imagery trainer: from embodied interaction to conceptual learning , 2011, CHI.

[62]  Takayuki Adachi,et al.  Human SUGOROKU: full-body interaction system for students to learn vegetation succession , 2013, IDC.

[63]  Jonas Fritsch,et al.  Kinesthetic interaction: revealing the bodily potential in interaction design , 2008, OZCHI '08.

[64]  Steffi Heidig,et al.  Applying HOPSCOTCH as an exer-learning game in English lessons: two exploratory studies , 2013, Educational Technology Research and Development.

[65]  B. Wilson.  Constructivist Learning Environments: Case Studies in Instructional Design , 1995 .

[66]  Susan Goldin-Meadow,et al.  Truth Is at Hand , 2010, Psychological science.

[67]  Greg Corness,et al.  Playing with the sound maker: do embodied metaphors help children learn? , 2008, IDC.