Playing with the sound maker: do embodied metaphors help children learn?

In this paper we present the results of a comparative study that explores the potential benefits of using embodied interaction to help children, aged 7 to 10, learn abstract concepts related to musical sounds. Forty children learned to create musical sound sequences using an interactive sound making environment. Half the children used a version of the system that instantiated a body-based metaphor in the mapping layer connecting body movements to output sounds. The remaining children used a version of the same environment that did not instantiate a metaphor in the mapping layer. In general, children were able to more accurately demonstrate sound sequences in the embodied metaphor based system version. However, we observed that children often resorted to spatial rather than body-based metaphors and that the mapping must be easily discoverable as well as metaphorical to provide benefit.

[1]  P. L. Adams.  THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[2]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[3]  Marja-Leena Juntunen,et al.  Embodiment in musical knowing: how body movement facilitates learning within Dalcroze Eurhythmics , 2004, British Journal of Music Education.

[4]  Todd Winkler,et al.  Making Motion Musical: Gesture Mapping Strategies for Interactive Computer Music , 1995, ICMC.

[5]  Hiroshi Ishii,et al.  BodyBeats: whole-body, musical interfaces for children , 2006, CHI Extended Abstracts.

[6]  Ron Wakkary,et al.  Exploring ambient sound techniques in the design of responsive environments for children , 2007, Tangible and Embedded Interaction.

[7]  Alissa Nicole Antle,et al.  The CTI framework: informing the design of tangible systems for children , 2007, TEI.

[8]  Antonio Rodà,et al.  PHYSICAL MOVEMENT AND MUSICAL GESTURES : A MULTILEVEL MAPPING STRATEGY , 2005 .

[9]  Mark L. Johnson.  The body in the mind: the bodily basis of meaning , 1987 .

[10]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[11]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[12]  David Birchfield,et al.  SMALLab: a mediated platform for education , 2006, SIGGRAPH '06.

[13]  Danae Stanton Fraser,et al.  Literature Review in Learning with Tangible Technologies , 2004 .

[14]  Liam J. Bannon,et al.  "...a load of ould boxology!" , 2002, DIS '02.

[15]  R. Wallace.  The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason , 1988 .

[16]  D. Myers.  Intuition: Its Powers and Perils , 2002 .

[17]  Peta Wyeth,et al.  Agency, tangible technology and young children , 2007, IDC.

[18]  Mitchel Resnick,et al.  Computer as Paintbrush: Technology, Play, and the Creative Society , 2006 .

[19]  Vladimir M. Sloutsky,et al.  Do Children Need Concrete Instantiations to Learn an Abstract Concept , 2006 .

[20]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[21]  Marcelo M. Wanderley,et al.  The Importance of Parameter Mapping in Electronic Instrument Design , 2002, NIME.

[22]  Tim Rohrer,et al.  Final Draft: The Body in Space © 2006-7 Rohrer In Body, Language and Mind, v. 1, 339-378 The Body in Space: Dimensions of Embodiment , 2007 .

[23]  Jiao Jian-li.  Literature Review in Learning with Tangible Technologies , 2008 .

[24]  WL Amsterdam.  ‘ ensemble ’ : Playing with Sensors and Sound , 2008 .

[25]  S. Gallagher.  How the body shapes the mind , 2005 .

[26]  Alissa Nicole Antle,et al.  Designing tangibles for children: what designers need to know , 2007, CHI Extended Abstracts.

[27]  Jörn Hurtienne,et al.  Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction , 2007, TEI.

[28]  Paul Dourish,et al.  Where the action is , 2001 .

[29]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[30]  Alexander Refsum Jensenius,et al.  Action-sound : developing methods and tools to study music-related body movement , 2007 .