EvalMe: Exploring the Value of New Technologies for In Situ Evaluation of Learning Experiences

Tangible interfaces have much potential for engendering shared interaction and reflection, as well as for promoting playful experiences. How can their properties be capitalised on to enable students to reflect on their learning, both individually and together, throughout learning sessions? This Research through Design paper describes our development of EvalMe, a flexible, tangible tool aimed at being playful, enjoyable to use and enabling children to reflect on their learning, both in the moment and after a learning session has ended. We discuss the insights gained through the process of designing EvalMe, co-defining its functionality with two groups of collaborators and deploying it in two workshop settings. Through this process, we map key contextual considerations for the design of technologies for in situ evaluation of learning experiences. Finally, we discuss how tangible evaluation technologies deployed throughout a learning session, can positively contribute to students’ reflection about their learning.

[1]  Yvonne Rogers,et al.  Ubi-learning Integrates INDOOR AND OUTDOOR , 2005 .

[2]  P. Robert-Jan Simons,et al.  Streaming video to enhance students' reflection in dance education , 2009, Comput. Educ..

[3]  D. Boud,et al.  Reflection, turning experience into learning , 1985 .

[4]  Yvonne Rogers,et al.  A framework for designing sensor-based interactions to promote exploration and reflection in play , 2006, Int. J. Hum. Comput. Stud..

[5]  Ioannis Stamelos,et al.  The value of writing-to-learn when using question prompts to support web-based learning in ill-structured domains , 2011 .

[6]  Yvonne Rogers,et al.  SmallTalk: Using Tangible Interactions to Gather Feedback from Children , 2016, TEI.

[7]  Panos Markopoulos,et al.  A comparison of think-aloud and post-task interview for usability testing with children , 2004, IDC '04.

[8]  Jane E Caldwell,et al.  Clickers in the large classroom: current research and best-practice tips. , 2007, CBE life sciences education.

[9]  Yvonne Rogers,et al.  Squeezy Green Balls: Promoting Environmental Awareness through Playful Interactions , 2016, CHI PLAY.

[10]  Sara Price,et al.  The effect of representation location on interaction in a tangible learning environment , 2009, TEI.

[11]  David Metcalf,et al.  My Sports Pulse: Increasing Student Interest in STEM Disciplines through Sports Themes, Games and Mobile Technologies , 2008, Fifth IEEE International Conference on Wireless, Mobile, and Ubiquitous Technology in Education (wmute 2008).

[12]  John Zimmerman,et al.  Research Through Design in HCI , 2014, Ways of Knowing in HCI.

[13]  John Vines,et al.  Research Through Design: Twenty-First Century Makers and Materialities , 2017, Design Issues.

[14]  Rudi Villing,et al.  Evaluation of a smartphone-based student response system for providing high quality real-time responses in a distributed classroom , 2014 .

[15]  Geraldine Fitzpatrick,et al.  Reflecting on reflection: framing a design landscape , 2010, OZCHI '10.

[16]  Alyssa Friend Wise,et al.  Getting Down to Details: Using Theories of Cognition and Learning to Inform Tangible User Interface Design , 2013, Interact. Comput..

[17]  Ahmed Kharrufa,et al.  ThinkActive: Designing for Pseudonymous Activity Tracking in the Classroom , 2018, CHI.

[18]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[19]  Yvonne Rogers,et al.  VoxBox: A Tangible Machine that Gathers Opinions from the Public at Events , 2015, TEI.

[20]  William W. Gaver,et al.  Designing for homo ludens , 2002 .

[21]  Hyeonjin Kim,et al.  Grounded design of web-enhanced case-based activity , 2008 .

[22]  Robin H. Kay,et al.  Examining the benefits and challenges of using audience response systems: A review of the literature , 2009, Comput. Educ..

[23]  Yvonne Rogers,et al.  Using Ubiquitous Computing to Extend and Enhance Learning Experiences , 2006 .

[24]  Gwo-Jen Hwang,et al.  Conducting Situated Learning in a Context-Aware Ubiquitous Learning Environment , 2008, Fifth IEEE International Conference on Wireless, Mobile, and Ubiquitous Technology in Education (wmute 2008).

[25]  Janet C. Read,et al.  Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers , 2008 .

[26]  Victor R. Lee,et al.  Quantified recess: design of an activity for elementary students involving analyses of their own movement data , 2013, IDC.

[27]  Gerald Bergtrom,et al.  Clicker Sets as Learning Objects , 2006 .

[28]  Yvonne Rogers,et al.  Enticing People to Interact with Large Public Displays in Public Spaces , 2003, INTERACT.