Five Degrees of Happiness: Effective Smiley Face Likert Scales for Evaluating with Children

This paper focuses on achieving optimal responses through supporting children's judgements, using Smiley Face Likert scales as a rating scale for quantitative questions in evaluations. It highlights the need to provide appropriate methods for children to communicate judgements, highlighting that the traditional Smiley Face Likert scale does not provide an appropriate method. The paper outlines a range of studies, identifying that to achieve differentiated data and full use of rating scales by children that faces with positive emotions should be used within Smiley Face Likert scales. The proposed rating method, the Five Degrees of Happiness Smiley Face Likert scale, was used in a large-scale summative evaluation of a Serious Game resulting in variance within and between children, with all points of the scale used.

[1]  J. Heckman,et al.  Are validated questionnaires valid? , 2006, The Journal of bone and joint surgery. American volume.

[2]  A. Bell Designing and testing questionnaires for children , 2007 .

[3]  Elisabeth André,et al.  A Pictorial Interaction Language for Children to Communicate with Cultural Virtual Characters , 2014, HCI.

[4]  Christine M. Rubie-Davies,et al.  The Dangers of Extreme Positive Responses in Likert Scales Administered to Young Children , 2012 .

[5]  Paul Marshall,et al.  Editorial: the evolving field of tangible interaction for children: the challenge of empirical validation , 2012, Personal and Ubiquitous Computing.

[6]  K. Moore,et al.  The use of Likert scales with children. , 2014, Journal of pediatric psychology.

[7]  Ana Paiva,et al.  Serious game evaluation as a meta-game , 2013, Interact. Technol. Smart Educ..

[8]  Laura Reynolds-Keefer,et al.  Is a Picture Is Worth a Thousand Words? Creating Effective Questionnaires with Pictures. , 2011 .

[9]  Janet C. Read,et al.  Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers , 2008 .

[10]  M. Orne On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[11]  K. Brownell,et al.  Influence of Licensed Characters on Children's Taste and Snack Preferences , 2010, Pediatrics.

[12]  C. Chambers,et al.  Developmental differences in children's use of rating scales. , 2002, Journal of pediatric psychology.

[13]  Ruth Aylett,et al.  Engaging with virtual characters using a pictorial interaction language , 2014, CHI Extended Abstracts.

[14]  Sandeep K. Tatla The development of the Pediatric Motivation Scale for children in rehabilitation : a pilot study , 2014 .

[15]  Warren Buckleitner The State of Children’s Software Evaluation—Yesterday, Today, and in the 21st Century , 1999 .

[16]  Klaus J. Templer,et al.  Cultural Intelligence: Its Measurement and Effects on Cultural Judgment and Decision Making, Cultural Adaptation and Task Performance , 2007, Management and Organization Review.

[17]  H. Laerhoven,et al.  A comparison of Likert scale and visual analogue scales as response options in children's questionnaires , 2004, Acta paediatrica.

[18]  Laura Reynolds-Keefer,et al.  Validity Issues in the Use of Pictorial Likert Scales , 2009 .

[19]  Jean-Xavier Guinard,et al.  Sensory and consumer testing with children , 2000 .

[20]  A. Costello,et al.  "We Used a Validated Questionnaire": What Does This Mean and Is It an Accurate Statement in Urologic Research? , 2015, Urology.

[21]  J. Read,et al.  Endurability, Engagement and Expectations: Measuring Children’s Fun , 2002 .

[22]  Lynne Hall,et al.  Why numbers, invites and visits are not enough: Evaluating the user experience in Social Eco-Systems , 2011 .

[23]  Vero Vanden Abeele,et al.  Measuring product liking in preschool children: An evaluation of the Smileyometer and This or That methods , 2013, Int. J. Child Comput. Interact..

[24]  J. Matson,et al.  Reliability and Validity of the Matson Evaluation of Social Skills With Youngsters , 2010, Behavior modification.

[25]  Daniel Danner,et al.  Acquiescence in personality questionnaires: Relevance, domain specificity, and stability☆ , 2015 .

[26]  Marc Leman,et al.  Interactive technologies in the instrumental music classroom: A longitudinal study with the Music Paint Machine , 2014, Comput. Educ..

[27]  S. Cobb,et al.  Collaborative virtual environment for conducting design sessions with students with autism spectrum conditions , 2012 .

[28]  Jim McCambridge,et al.  The Effects of Demand Characteristics on Research Participant Behaviours in Non-Laboratory Settings: A Systematic Review , 2012, PloS one.

[29]  Shamila Haddad,et al.  Questionnaire Design to Determine Children's Thermal Sensation, Preference and Acceptability in the Classroom , 2012 .

[30]  R. Tourangeau,et al.  Cognitive Processes Underlying Context Effects in Attitude Measurement , 1988 .

[31]  E.M.A.G. van Dijk,et al.  Measuring fun and enjoyment of children in a museum: evaluating the smileyometer , 2012 .

[32]  Arvid Kappas,et al.  Learning to Overcome Cultural Conflict through Engaging with Intelligent Agents in Synthetic Cultures , 2014, International Journal of Artificial Intelligence in Education.

[33]  Janet C. Read,et al.  Evaluating children's interactive products , 2014, CHI Extended Abstracts.

[34]  Jon A. Krosnick,et al.  Answering Questions: A Comparison of Survey Satisficing and Mindlessness , 2014 .

[35]  F. Bogner,et al.  Social Desirability, Environmental Attitudes, and General Ecological Behaviour in Children , 2013 .

[36]  Leslie Haddon,et al.  Children’s use of online technologies in Europe: a review of the European evidence base , 2013 .

[37]  Sue Cobb,et al.  A Collaborative Virtual Environment for Conducting Design Sessions with Students with Autism Spectrum Disorder , 2014 .

[38]  Mariano Alcañiz Raya,et al.  Manipulating Virtual Objects with Your Hands: A Case Study on Applying Desktop Augmented Reality at the Primary School , 2013, 2013 46th Hawaii International Conference on System Sciences.