A Tablet-Computer-Based Tool to Facilitate Accurate Self-Assessments in Third- and Fourth-Graders

Although student self-assessment is positively related to achievement, skepticism about the accuracy of students’ self-assessments remains. A few studies have shown that even elementary school students are able to provide accurate self-assessments when certain conditions are met. We developed an innovative tablet-computer-based tool for capturing self-assessments of mathematics and reading comprehension. This tool integrates the conditions required for accurate self-assessment: (1) a non-competitive setting, (2) items formulated on the task level, and (3) limited reading and no verbalization required. The innovation consists of using illustrations and a language-reduced rating scale. The correlations between students’ self-assessment scores and their standardized test scores were moderate to large. Independent of their proficiency level, students’ confidence in completing a task decreased as task difficulty increased, but these findings were more consistent in mathematics than in reading comprehension. We conclude that third- and fourth-graders have the ability to provide accurate self-assessments of their competencies, particularly in mathematics, when provided with an adequate self-assessment tool.

[1]  Betty Liebovich.  Children's Self Assessment , 2000 .

[2]  Philip H. Ramsey,et al.  Pairwise comparisons of means under realistic nonnormality, unequal variances, outliers and equal sample sizes , 2011 .

[3]  Orrin T. Murray,et al.  Teaching and Learning with iPads, Ready or Not? , 2011 .

[4]  J. Gaa.  EFFECTS OF INDIVIDUAL GOAL-SETTING CONFERENCES ON ACHIEVEMENT, ATTITUDES, AND GOAL-SETTING BEHAVIOR , 1973 .

[5]  Y. Eshel,et al.  Development of Academic Self-Concept of Lower-Class and Middle-Class Primary School Children. , 1981 .

[6]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[7]  H. Laerhoven,et al.  A comparison of Likert scale and visual analogue scales as response options in children's questionnaires , 2004, Acta paediatrica.

[8]  J. H. McMillan.  Sage handbook of research on classroom assessment , 2013 .

[9]  H. Andrade,et al.  Rubric-Referenced Self-Assessment and Self-Efficacy for Writing , 2009 .

[10]  J. Eccles,et al.  The Development of Students' Mathematics Self-Concept in Relation to Gender: Different Countries, Different Trajectories?. , 2010 .

[11]  Alexandre Pouget,et al.  Young Children Bet on Their Numerical Skills , 2014, Psychological science.

[12]  Meera Komarraju,et al.  Self-efficacy and academic achievement: Why do implicit beliefs, goals, and effort regulation matter? , 2013 .

[13]  Ruth Butler,et al.  Are positive illusions about academic competence always adaptive, under all circumstances: New results and future directions , 2011 .

[14]  Carol Rolheiser,et al.  Student Self-Evaluation in Grade 5-6 Mathematics Effects on Problem- Solving Achievement , 2002 .

[15]  W. Schneider.  The Development of Metacognitive Knowledge in Children and Adolescents: Major Trends and Implications for Education , 2008 .

[16]  J. Connell,et al.  Self-system concomitants of discrepancies between children's and teacher's evaluations of academic competence. , 1987, Child development.

[17]  Gregory J. Boyle,et al.  Self-Description Questionnaire II. , 1994 .

[18]  Glenn Regehr,et al.  Measuring Self-assessment: Current State of the Art , 2002, Advances in health sciences education : theory and practice.

[19]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[20]  N. Clyne.  Teachers and iPads in the first three years of school: Using a teacher activity system to explore factors influencing the use of tablet technology in the classroom , 2020 .

[21]  J. Earl,et al.  Accuracy in Self-Assessment: The Role of Ability, Feedback, Self-Efficacy and Goal Orientation , 2008 .

[22]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[23]  David T. Gordon,et al.  The digital classroom : how technology is changing the way we teach and learn , 2000 .

[24]  B. Hout-Wolters,et al.  Metacognition and learning: conceptual and methodological considerations , 2006 .

[25]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[26]  Maladaptive motivational style: the role of domain specific task demand in English and mathematics , 1996 .

[27]  Howard J. Sullivan,et al.  External Evaluation, Task Difficulty, and Continuing Motivation , 1985 .

[28]  M. Bong.  Predictive Utility of Subject-, Task-, and Problem-Specific Self-Efficacy Judgments for Immediate and Delayed Academic Performances , 2002 .

[29]  A. Bandura.  Social cognitive theory of self-regulation☆ , 1991 .

[30]  Dale H. Schunk,et al.  Goal and Self-Evaluative Influences During Children’s Cognitive Skill Learning , 1996 .

[31]  Do Students Effectively Monitor Their Comprehension , 2001 .

[32]  John A. Ross.  The Reliability, Validity, and Utility of Self-Assessment , 2006 .

[33]  Gavin T. L. Brown,et al.  Accuracy in student self-assessment: directions and cautions for research , 2015 .

[34]  Carol Rolheiser,et al.  Effects of Self-Evaluation Training on Narrative Writing. , 1999 .

[35]  H. Sullivan,et al.  Effects of Teacher and Self-Assessment on Student Performance. , 2002 .

[36]  T. A. Warm.  Weighted likelihood estimation of ability in item response theory , 1989 .

[37]  Susan Harter,et al.  Perceived Competence Scale for Children , 2011 .

[38]  Margaret J. Johnson,et al.  Gender differences in writing self-beliefs of elementary school students. , 1999 .

[39]  Gavin T. L. Brown,et al.  The Future of Student Self-Assessment: a Review of Known Unknowns and Potential Directions , 2016 .

[40]  D. Kwok,et al.  THE SELF-PERCEPTION OF COMPETENCE BY CANADIAN AND CHINESE CHILDREN , 1993 .

[41]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[42]  Morwenna Griffiths,et al.  Learning to Learn: action research from an equal opportunities perspective in a junior school , 1993 .

[43]  R. Mayer,et al.  Aids to computer-based multimedia learning , 2002 .

[44]  R. Butler.  The effects of mastery and competitive conditions on self-assessment at different ages. , 1990, Child development.

[45]  Bengt B. Arnetz,et al.  Validation and Findings Comparing VAS vs. Likert Scales for Psychosocial Measurements , 2005 .

[46]  S Harter,et al.  The pictorial scale of perceived competence and social acceptance for young children. , 1984, Child development.

[47]  Daniel L. Dinsmore,et al.  Student participation in assessment: does it influence self-regulation? , 2016 .

[48]  Eric Zhi-Feng Liu,et al.  Exploring the Media Literacy of Taiwanese Elementary School Students , 2011 .

[49]  Gavin T. L. Brown,et al.  The Future of Self-Assessment in Classroom Practice: Reframing Self-Assessment as a Core Competency. , 2014 .

[50]  Mimi Bong,et al.  Academic Self-Concept and Self-Efficacy: How Different Are They Really? , 2003 .

[51]  T. C. Oshima,et al.  Type I Error Rates for Welch’s Test and James’s Second-Order Test Under Nonnormality and Inequality of Variance When There Are Two Groups , 1994 .

[52]  Richard E. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[53]  Geoff Munns,et al.  Student engagement and student self‐assessment: the REAL framework , 2006 .

[54]  Terry C. Ley,et al.  Portfolios and Second Graders' Self-Assessments of Their Development as Writers. , 1996 .

[55]  Z. Križan,et al.  Do People Have Insight Into Their Abilities? A Metasynthesis , 2014, Perspectives on psychological science : a journal of the Association for Psychological Science.

[56]  David Fontana,et al.  Improvements in mathematics performance as a consequence of self-assessment in Portuguese primary school pupils. , 1994 .

[57]  B. Zimmerman.  A social cognitive view of self-regulated academic learning. , 1989 .

[58]  Nathan R. Kuncel,et al.  The Validity of Self-Reported Grade Point Averages, Class Ranks, and Test Scores: A Meta-Analysis and Review of the Literature , 2005 .

[59]  J. Nicholls.  Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. , 1984 .

[60]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[61]  F. Dochy,et al.  Student self-assessment: Assessment, learning and empowerment 1 Student self-assessment: Assessment, learning and empowerment, Kelvin Heng-Kiat Tan (2012) Singapore: Research Publishing. ISBN 978-981-08-9442-9 , 2018 .

[62]  Deborah J. Stipek,et al.  Developmental change in children's assessment of intellectual competence , 1989 .

[63]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .

[64]  Kathy Hirsh-Pasek,et al.  Putting Education in “Educational” Apps , 2015, Psychological science in the public interest : a journal of the American Psychological Society.

[65]  John G. Nicholls,et al.  The Development of the Concepts of Effort and Ability, Perception of Academic Attainment, and the Understanding that Difficult Tasks Require More Ability. , 1978 .

[66]  Yuko Goto Butler,et al.  On-Task versus Off-Task Self-Assessments among Korean Elementary School Students Studying English. , 2006 .

[67]  Linda Shaw,et al.  The Digital Classroom: How Technology Is Changing The Way We Teach and Learn , 2001, J. Educ. Technol. Soc..

[68]  Tamara van Gog,et al.  Activation of inaccurate prior knowledge affects primary-school students' metacognitive judgments and calibration , 2013 .

[69]  Heidi Andrade,et al.  Putting Rubrics to the Test: The Effect of a Model, Criteria Generation, and Rubric‐Referenced Self‐Assessment on Elementary School Students' Writing , 2008 .

[70]  D. Wagener,et al.  Personalarbeit mit dem komplexen Szenario FSYS : Validität und Potential von Verhaltensskalen , 2002 .

[71]  John G. Nicholls,et al.  The Differentiation of the Concepts of Difficulty and Ability. , 1983 .