Skill and will: test‐taking motivation and assessment quality

An achievement test score can be viewed as a joint function of skill and will, of knowledge and motivation. However, when interpreting and using test scores, the ‘will’ part is not always acknowledged and scores are mostly interpreted and used as pure measures of student knowledge. This paper argues that students’ motivation to do their best on the assessment – their test‐taking motivation – is important to consider from an assessment validity perspective. This is true not least in assessment contexts where the assessment outcome has no consequences for the test‐taker. The paper further argues that the quality of assessment of test‐taking motivation also needs attention. Theoretical and methodological issues related to the assessment of test‐taking motivation are presented from a validity perspective, and findings from empirical studies on the relation between test stakes, test‐taking motivation and test performance are presented.

[1]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[2]  Jeffrey K. Smith,et al.  Consequence of Performance, Test, Motivation, and Mentally Taxing Items , 1995 .

[3]  Steven L. Wise,et al.  Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests , 2005 .

[4]  Christine E. DeMars,et al.  Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions , 2005 .

[5]  P. Pintrich,et al.  Motivation in Education: Theory, Research, and Applications , 1995 .

[6]  Carol L. Barry,et al.  1 Exploring Change in Test-Taking Motivation , 2009 .

[7]  Jeffrey K. Smith,et al.  The Consequence of Consequence: Motivation, Anxiety, and Test Performance , 1995 .

[8]  T. Bauer,et al.  Development and examination of an expectancy-based measure of test-taking motivation. , 2000, The Journal of applied psychology.

[9]  Jamal Abedi,et al.  Monetary Incentives for Low-Stakes Tests , 2005 .

[10]  R. Burchfield.  Oxford English dictionary , 1982 .

[11]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[12]  Educational Evaluation.  Standards for Educational and Psychological Testing , 1999 .

[13]  Hanna Eklöf,et al.  Development and Validation of Scores From an Instrument Measuring Student Test-Taking Motivation , 2006 .

[14]  J. W. Atkinson.  Motivational determinants of risk-taking behavior. , 1957, Psychological review.

[15]  Donna L. Sundre,et al.  An exploration of the psychology of the examinee: Can examinee self-regulation and test-taking motivation predict consequential and non-consequential test performance? , 2004 .

[16]  Richard P. DeShon,et al.  Reactions to cognitive ability tests: the relationships between race, test performance, face validity perceptions, and test-taking motivation. , 1997, The Journal of applied psychology.

[17]  J. Eccles,et al.  Motivational beliefs, values, and goals. , 2002, Annual review of psychology.

[18]  Donna L. Sundre,et al.  Motivation Matters: Using the Student Opinion Scale to Make Valid Inferences About Student Performance , 2009, The Journal of General Education.

[19]  Jürgen Baumert,et al.  Test motivation in the assessment of student skills: The effects of incentives on motivation and performance , 2001 .

[20]  J. Eccles,et al.  The Development of Competence Beliefs, Expectancies for Success, and Achievement Values from Childhood through Adolescence , 2002 .

[21]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[22]  W. Harlen,et al.  Testing and Motivation for Learning , 2003 .

[23]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[24]  A. Hughes.  Oxford English Dictionary. , 2008, Isis; an international review devoted to the history of science and its cultural influences.

[25]  Hanna Eklöf.  Test-taking motivation on low-stakes tests : A Swedish TIMSS 2003 example , 2008 .

[26]  Christine E. DeMars.  Test Stakes and Item Format Interactions , 2000 .

[27]  H. Walberg,et al.  Motivational Effects on Test Scores of Elementary Students , 1993 .

[28]  John Price-Wilkin,et al.  Oxford English Dictionary (2nd ed.) , 1991 .

[29]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[30]  S. Wise,et al.  The Generalizability of Motivation Filtering in Improving Test Score Validity , 2006 .

[31]  M. Zeidner.  Essay Versus Multiple-Choice Type Classroom Exams: The Student's Perspective. , 1987 .