Simplifying Heuristic Evaluation for Older Children

This paper aims to identify whether children can perform a heuristic evaluation based on a new modified method. In total 12 children placed in groups of 4 participated in the study, evaluating a music making game on a laptop. The results showed that children could perform a heuristic evaluation, identifying genuine usability problems using the simplified method. The effectiveness of the method was measured against ease of use for aspects such as mapping problem to game rules (heuristics), using the 'Bad Scale' (severity) and the number of observed errors reported. The children struggled to map all the problems to the game rules and had difficulty rating some problems to the new 'Bad Scale'. Further research will be performed to refine the process in an attempt to eliminate reported issues thus improving the method for children.

[1]  Gavriel Salvendy,et al.  Effect of evaluators' cognitive style on heuristic evaluation: Field dependent and field independent evaluators , 2009, Int. J. Hum. Comput. Stud..

[2]  Panos Markopoulos,et al.  A comparison of think-aloud and post-task interview for usability testing with children , 2004, IDC '04.

[3]  Juan Pablo Hourcade,et al.  Child computer interaction , 2008, CHI Extended Abstracts.

[4]  Janet C. Read,et al.  Can children perform a heuristic evaluation? , 2013, APCHI.

[5]  B. Bederson,et al.  Children as our technology design partners , 1998 .

[6]  Vero Vanden Abeele,et al.  Laddering with young children in User eXperience evaluations: theoretical groundings and a practical case , 2010, IDC.

[7]  Elina M. I. Koivisto,et al.  Playability heuristics for mobile multi-player games , 2007, DIMEA.

[8]  S. MacFarlane,et al.  Adapting the Heuristic Evaluation Method for Use with Children , 2006 .

[9]  Yvonne Rogers,et al.  Kids as informants: telling us what we didn't know or confirming what we knew already? , 1998 .

[10]  Gilbert Cockton,et al.  Understanding Inspection Methods: Lessons from an Assessment of Heuristic Evaluation , 2001, BCS HCI/IHM.

[11]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[12]  Ole Iversen,et al.  Building a BRIDGE between children and users: a socio-cultural approach to child–computer interaction , 2008, Cognition, Technology & Work.

[13]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[14]  Ebba Þóra Hvannberg,et al.  Consolidating usability problems with novice evaluators , 2008, NordiCHI.

[15]  Gilbert Cockton,et al.  Testing a conjecture based on the DR-AR Model of UIM effectiveness , 2002 .

[16]  Janet C. Read,et al.  Validating the Fun Toolkit: an instrument for measuring children’s opinions of technology , 2008, Cognition, Technology & Work.

[17]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[18]  Kenton O'Hara,et al.  Social Impact , 2019, Encyclopedia of Food and Agricultural Ethics.

[19]  Stuart MacFarlane,et al.  Using the fun toolkit and other survey methods to gather opinions in child computer interaction , 2006, IDC '06.

[20]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.