Usability Testing with Children : Comparing Think-Aloud and Constructive Interaction

Constructive interaction provides natural thinking-aloud as test subjects collaborate to solve tasks. Since children may face difficulties in following instructions for a standard think-aloud test, constructive interaction has been suggested as evaluation method when conducting usability testing with children. However, the relationship between thinkaloud and constructive interaction is still poorly understood. We present an experiment that compares think-aloud and constructive interaction in usability testing. The experiment involves 60 children with three setups where children apply think-aloud, and constructive interaction in acquainted and non-acquainted dyads. Our results show that the pairing of children had impact on identification of usability problems as acquainted dyads identified more problems both in total and of the most severe than non-acquainted dyads and individual testers.

[1]  Naomi Miyake,et al.  Constructive Interaction and the Iterative Process of Understanding , 1986, Cogn. Sci..

[2]  Mitchel Resnick,et al.  Digital manipulatives: new toys to think with , 1998, CHI.

[3]  Allison Druin,et al.  The Role of Children in the Design Technology , 1999 .

[4]  B. Bederson,et al.  Designing storytelling technologies to encouraging collaboration between young children , 2000, CHI.

[5]  Allison Druin,et al.  The design of children's technology , 1998 .

[6]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[7]  Jaime Sánchez,et al.  Interactive 3D sound hyperstories for blind children , 1999, CHI '99.

[8]  Panos Markopoulos,et al.  On the assessment of usability testing methods for children , 2003, Interact. Comput..

[9]  Justine Cassell,et al.  Making Space for Voice: Technologies to Support Children’s Fantasy and Storytelling , 2001, Personal and Ubiquitous Computing.

[10]  Yvonne Rogers,et al.  Designing for or designing with? Informant design for interactive learning environments , 1997, CHI.

[11]  Clare-Marie Karat,et al.  Comparison of empirical testing and walkthrough methods in user interface evaluation , 1992, CHI.

[12]  Wayne D. Gray,et al.  Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods , 1998, Hum. Comput. Interact..

[13]  S. Kennedy,et al.  Using video in the BNR usability lab , 1989, SGCH.

[14]  Marina Umaschi Bers,et al.  Identity construction environments: supporting a virtual therapeutic community of pediatric patients undergoing dialysis , 2001, CHI.

[15]  Kirsten Risden,et al.  Guidelines for usability testing with children , 1997, INTR.

[16]  Stellan Ohlsson,et al.  Bridging strategies for VR-based learning , 1999, CHI '99.