Multimodal methodological approach for participatory design of Full-Body Interaction Learning Environments

Over the past years an increasing number of digital learning environments based on Full-Body Interaction have been developed. Research in this field is often based on Designer-Driven approaches and is only recently employing Participatory Design techniques. However, these participatory approaches have reported relevant challenges related to including users in the design of spatial and bodily qualities of interaction. These shortcomings require extending research methods to effectively focus on embodied resources in the essential design and evaluation processes. To address this issue, we propose a methodological approach that combines multimodal analysis with Participatory Design techniques to include embodied resources in the participatory design processes for Full-Body Interaction. The proposed approach is applied to the iterative design of two Full-Body Interaction Learning Environments. Through the analysis of the outcomes of these case studies, we discuss the affordances multimodal analysis can offer to inform and guide the design process for embodied interaction.

[1]  Glenda Revelle,et al.  Applying developmental theory and research to the creation of educational games. , 2013, New directions for child and adolescent development.

[2]  Laura Malinverni,et al.  An evaluation-driven design approach to develop learning environments based on full-body interaction , 2016 .

[3]  Rob Nadolski,et al.  Guest Editorial: Game Based Learning for 21st Century Transferable Skills: Challenges and Opportunities , 2014, J. Educ. Technol. Soc..

[4]  Greg Corness,et al.  Playing with the sound maker: do embodied metaphors help children learn? , 2008, IDC.

[5]  Toni Robertson,et al.  Moving and making strange: An embodied approach to movement-based interaction design , 2013, TCHI.

[6]  David Kirsh,et al.  Embodied cognition and the magical future of interaction design , 2013, TCHI.

[7]  Yvonne Rogers,et al.  Let's get physical: The learning benefits of interacting in digitally augmented physical spaces , 2004, Comput. Educ..

[8]  Alissa N. Antle,et al.  Research opportunities: Embodied child-computer interaction , 2013, Int. J. Child Comput. Interact..

[9]  Laura Malinverni,et al.  Participatory design methods to define educational goals for full-body interaction , 2014, Advances in Computer Entertainment.

[10]  Perttu Hämäläinen,et al.  Children's intuitive gestures in vision-based action games , 2005, CACM.

[11]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[12]  Paul Dourish,et al.  Where the action is , 2001 .

[13]  D. Schoen The Reflective Practitioner , 1983 .

[14]  Sara Price,et al.  Exploring Whole-Body Interaction and Design for Museums , 2016, Interact. Comput..

[15]  Allison Druin,et al.  The Role of Children in the Design Technology , 1999 .

[16]  Noel Enyedy,et al.  Learning physics through play in an augmented reality environment , 2012, Int. J. Comput. Support. Collab. Learn..

[17]  Sara Price,et al.  The role of touch in preschool children’s learning using iPad versus paper interaction , 2014, The Australian Journal of Language and Literacy.

[18]  Eva Hornecker,et al.  Modifying Gesture Elicitation: Do Kinaesthetic Priming and Increased Production Reduce Legacy Bias? , 2016, Tangible and Embedded Interaction.

[19]  Susan Goldin-Meadow,et al.  Learning through gesture. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[20]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[21]  Sara Price,et al.  A multimodal approach to examining 'embodiment' in tangible learning environments , 2013, TEI '13.

[22]  Andrew Large,et al.  Children in the information technology design process: A review of theories and their applications , 2004 .

[23]  Carey Jewitt,et al.  Multimodal methods for researching digital technologies , 2013 .

[24]  Kaj Grønbæk,et al.  Interactive Floor Support for Kinesthetic Interaction in Children Learning Environments , 2007, INTERACT.

[25]  Narcís Parés,et al.  Making Sense of Body and Space through Full-Body Interaction Design: A Case Study , 2016, IDC.

[26]  A. Strauss,et al.  Grounded theory , 2017 .

[27]  Laura Malinverni,et al.  Sketching through the body: child-generated gestures in full-body interaction design , 2015, IDC.

[28]  R. Kozma Will media influence learning? Reframing the debate , 1994 .

[29]  Giulio Jacucci,et al.  On the move with a magic thing: role playing in concept design of mobile services and devices , 2000, DIS '00.

[30]  Narcís Parés,et al.  Lands of Fog: Helping Children with Autism in Social Interaction through a Full-Body Interactive Experience , 2016, IDC.

[31]  Bongshin Lee,et al.  Reducing legacy bias in gesture elicitation studies , 2014, INTR.

[32]  Laura Malinverni,et al.  Towards methods for evaluating and communicating participatory design: A multimodal approach , 2016, Int. J. Hum. Comput. Stud..

[33]  D. Kolb,et al.  Experiential Learning Theory: Previous Research and New Directions , 2000 .

[34]  Laura Malinverni,et al.  The medium matters: the impact of full-body interaction on the socio-affective aspects of collaboration , 2015, IDC.

[35]  Kristian T. Simsarian,et al.  Take it to the next stage: the roles of role playing in the design process , 2003, CHI Extended Abstracts.