What the body knows: Exploring the benefits of embodied metaphors in hybrid physical digital environments

A recent trend in ubiquitous computing is the development of new forms of interfaces, which rely on embodied interaction. We focus on the definition of embodiment that refers to the ways in which abstract concepts rely on metaphorical extensions of embodied schemata shaped by processes below the level of conscious awareness as explored by Lakoff and Johnson [Lakoff, G., Johnson, M., 1980. Metaphors We Live By. Chicago Press, Chicago, IL, USA]. Our inquiry focuses on understanding the role embodied metaphors may play in supporting people to understand the possibilities for physical interaction in augmented spaces. We explore this issue through the development and evaluation of an interactive audio environment. We instantiate metaphor theory by using embodied schemata as the basis for the interactional metaphor that relates full-body input actions to audio output responses. We demonstrate and explore the benefits of this approach through a comparative experiment in which adults and children learn to use our audio environment. The results from our experiment indicated that embodied metaphors improve usability however, other factors including discoverability, perceivability of feedback and duplicity of structural isomorphism may mediate these metaphor-based benefits. We have generalized our main findings as a set of suggestions for the design of embodied style interfaces that rely on physical interaction.

[1]  A. L. Fisher,et al.  "The Phenomenology of Perception," by Maurice Merleau-Ponty, trans. Colin Smith , 1964 .

[2]  Roger B. Dannenberg,et al.  SICIB: An Interactive Music Composition System Using Body Movements , 2001, Computer Music Journal.

[3]  John C. Thomas,et al.  Metaphor and the Cognitive Representation of Computing Systems , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  P. L. Adams THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[5]  A. Clark An embodied cognitive science? , 1999, Trends in Cognitive Sciences.

[6]  Hiroshi Ishii,et al.  BodyBeats: whole-body, musical interfaces for children , 2006, CHI Extended Abstracts.

[7]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[8]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[9]  Marja-Leena Juntunen,et al.  Embodiment in musical knowing: how body movement facilitates learning within Dalcroze Eurhythmics , 2004, British Journal of Music Education.

[10]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[11]  Liam J. Bannon,et al.  "...a load of ould boxology!" , 2002, DIS '02.

[12]  Thomas Erickson,et al.  Working with interface metaphors , 1995 .

[13]  S. Goldin-Meadow,et al.  Hearing Gesture: How Our Hands Help Us Think , 2003 .

[14]  Lucy Anne Wozny,et al.  The Application of Metaphor, Analogy, and Conceptual Models in Computer Systems , 1989, Interact. Comput..

[15]  David Benyon,et al.  Designing with Blends , 2007 .

[16]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[17]  Paul Dourish,et al.  From Interaction to Participation: Configuring Space Through Embodied Interaction , 2005, UbiComp.

[18]  Brenda K. Laurel,et al.  Interface as Mimesis , 1986 .

[19]  Antonio Rodà,et al.  PHYSICAL MOVEMENT AND MUSICAL GESTURES : A MULTILEVEL MAPPING STRATEGY , 2005 .

[20]  S. Ivie,et al.  Models and Metaphors. , 2007 .

[21]  D. Myers Intuition: Its Powers and Perils , 2002 .

[22]  Donald A. Norman,et al.  User-centered systems design , 1986 .

[23]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[24]  Kenneth P. Fishkin,et al.  A taxonomy for and analysis of tangible interfaces , 2004, Personal and Ubiquitous Computing.

[25]  Alan F. Blackwell,et al.  Using solid diagrams for tangible interface prototyping , 2005, IEEE Pervasive Comput..

[26]  N. Presmeg The body in the mind: The bodily basis of meaning, imagination and reason , 1992 .

[27]  R. Proctor,et al.  Stimulus-Response Compatibility Principles: Data, Theory, and Application , 2006 .

[28]  Alexander Refsum Jensenius,et al.  Action-sound : developing methods and tools to study music-related body movement , 2007 .

[29]  Allison Woodruff,et al.  Sotto voce: exploring the interplay of conversation and mobile audio spaces , 2002, CHI.

[30]  Dag Svanæs,et al.  Context-Aware Technology: A Phenomenological Perspective , 2001, Hum. Comput. Interact..

[31]  Ron Wakkary,et al.  Exploring ambient sound techniques in the design of responsive environments for children , 2007, Tangible and Embedded Interaction.

[32]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[33]  S. M. Hansen Where the action is. , 1985, Journal (National Association for Hospital Development (U.S.)).

[34]  Marcelo M. Wanderley,et al.  The Importance of Parameter Mapping in Electronic Instrument Design , 2002, NIME.

[35]  J. Searle Expression and Meaning: Studies in the Theory of Speech Acts , 1979 .

[36]  R. Mizen The embodied mind. , 2009, The Journal of analytical psychology.

[37]  M. Budd Musical Movement and Aesthetic Metaphors , 2003 .

[38]  Greg Corness,et al.  Playing with the sound maker: do embodied metaphors help children learn? , 2008, IDC.

[39]  Kristina Andersen 'Ensemble': playing with sensors and sound , 2004, CHI EA '04.

[40]  Alan F. Blackwell,et al.  The reification of metaphor as a design tool , 2006, TCHI.

[41]  S. Gallagher How the body shapes the mind , 2005 .

[42]  Todd Winkler,et al.  Making Motion Musical: Gesture Mapping Strategies for Interactive Computer Music , 1995, ICMC.

[43]  É. Jaques-Dalcroze,et al.  Eurhythmics, art and education , 1930 .

[44]  Steve Benford,et al.  A Framework for Tangible User Interfaces , 2003 .

[45]  R. Sellars Rhetoric , 1996, The Classical Review.

[46]  Maurice Merleau-Ponty Phenomenology of Perception , 1964 .

[47]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[48]  Jörn Hurtienne,et al.  Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction , 2007, TEI.

[49]  David Benyon,et al.  Designing with blends - conceptual foundations of human-computer interaction and software engineering , 2006 .