Exploring Verbalization and Collaboration of Constructive Interaction with Children

Constructive interaction provides natural thinking-aloud as test subjects collaborate in pairs to solve tasks. Since children may face difficulties in following instructions for a standard think-aloud test, constructive interaction has been suggested as evaluation method when usability testing with children. However, the relationship between think-aloud and constructive interaction is still poorly understood. We present an experiment that compares think-aloud and constructive interaction. The experiment involves 60 children with three setups where children apply think-aloud or constructive interaction in acquainted and non-acquainted pairs. Our results show that the pairing of children had impact on how the children collaborated in pairs and how they would afterward assess the testing sessions. In some cases, we found that acquainted dyads would perform well as they would more naturally interact and collaborate while in other cases they would have problems in controlling the evaluations.

[1]  Kori Inkpen Quinn,et al.  GeneyTM: designing a collaborative activity for the palmTM handheld computer , 2001, CHI.

[2]  Jaime Sánchez,et al.  Interactive 3D sound hyperstories for blind children , 1999, CHI '99.

[3]  Mikael B. Skov,et al.  Comparison of think-aloud and constructive interaction in usability testing with children , 2005, IDC '05.

[4]  S. G. Hart,et al.  Assessing the Subjective Workload of Directional Orientation Tasks , 1984 .

[5]  Allison Druin,et al.  The design of children's technology , 1998 .

[6]  Mikael B. Skov,et al.  A review of research methods in children's technology design , 2005, IDC '05.

[7]  Finn Kensing,et al.  Methods & tools: constructive interaction and collaborative work: introducing a method for testing collaborative systems , 2000, INTR.

[8]  Allison Druin,et al.  Designing Multimedia Environments for Children , 1996 .

[9]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[10]  Kirsten Risden,et al.  Guidelines for usability testing with children , 1997, INTR.

[11]  Yvonne Rogers,et al.  Designing for or designing with? Informant design for interactive learning environments , 1997, CHI.

[12]  Erik Strommen,et al.  When the interface is a talking dinosaur: learning across media with ActiMates Barney , 1998, CHI.

[13]  Mitchel Resnick,et al.  Digital manipulatives: new toys to think with , 1998, CHI.

[14]  B. Bederson,et al.  Designing storytelling technologies to encouraging collaboration between young children , 2000, CHI.

[15]  Allison Druin,et al.  The Role of Children in the Design Technology , 1999 .

[16]  H. Simon,et al.  Protocol Analysis: Verbal Reports as Data , 1986 .

[17]  Kori Inkpen,et al.  Three Important Research Agendas for Educational Multimedia: Learning, Children, and Gender , 1998 .

[18]  Cyndi Rader,et al.  Degrees of comprehension: children's understanding of a visual programming environment , 1997, CHI.

[19]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[20]  Mikael B. Skov,et al.  Designing a Drawing Tool for Children: Supporting Social Interaction and Communication , 2004 .

[21]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[22]  Helge Kahler,et al.  Constructive Interaction and Collaborative Work , 2000 .

[23]  Allison Druin,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[24]  Clare-Marie Karat,et al.  Comparison of empirical testing and walkthrough methods in user interface evaluation , 1992, CHI.

[25]  Marina Umaschi Bers,et al.  Identity construction environments: supporting a virtual therapeutic community of pediatric patients undergoing dialysis , 2001, CHI.

[26]  Allison Druin,et al.  Physical programming: designing tools for children to create physical interactive environments , 2002, CHI.

[27]  Amy Bruckman,et al.  Designing palaver tree online: supporting social roles in a community of oral history , 2001, CHI.

[28]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[29]  Justine Cassell,et al.  Genderizing human-computer interaction , 2002 .

[30]  Justine Cassell,et al.  Making Space for Voice: Technologies to Support Children’s Fantasy and Storytelling , 2001, Personal and Ubiquitous Computing.

[31]  Arnold P. O. S. Vermeeren,et al.  Assessing usability evaluation methods on their effectiveness to elicit verbal comments from children subjects , 2003, IDC '03.

[32]  Panos Markopoulos,et al.  On the assessment of usability testing methods for children , 2003, Interact. Comput..

[33]  Naomi Miyake,et al.  Constructive Interaction and the Iterative Process of Understanding , 1986, Cogn. Sci..

[34]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[35]  Claudia Medina,et al.  Engaging girls with computers through software games , 2000, Commun. ACM.

[36]  Allison Druin,et al.  Designing multimedia environments for children: computers, creativity, and kids , 1996 .

[37]  Stellan Ohlsson,et al.  Bridging strategies for VR-based learning , 1999, CHI '99.