MEASURING STUDENTS' COGNITIVE ENGAGEMENT ON ASSESSMENT TESTS: A CONFIRMATORY FACTOR ANALYSIS OF THE SHORT FORM OF THE COGNITIVE ENGAGEMENT SCALE

Motivational theory is often used to develop strategies for boosting student effort on assessments, particularly in low stakes situations. Increasing students’ cognitive engagement on such assessments may also impact student effort. However, before such interventions can be evaluated, a sound measure of cognitive engagement must be identified. This study examines the factor structure of a scale (CE-S) modified to measure students’ cognitive engagement specifically on assessment tests. A 2-factor model of cognitive engagement supports the interpretation of two subscale scores. The relationship between these subscale scores and scores on measures of motivation and goal orientation further supports two separate subscales of cognitive engagement. Future research and implications for use of the CE-S in assessment practice is discussed.

[1]  Donna L. Sundre,et al.  Motivation Matters: Using the Student Opinion Scale to Make Valid Inferences About Student Performance , 2009, The Journal of General Education.

[2]  Barbara A. Greene,et al.  Influences on achievement : Goals, perceived ability, and cognitive engagement , 1996 .

[3]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[4]  D. McCarthy,et al.  On the sins of short-form development. , 2000, Psychological assessment.

[5]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[6]  A. Elliot,et al.  On the measurement of achievement goals: critique, illustration, and application , 2008 .

[7]  J. Meece,et al.  Students' goal orientations and cognitive engagement in classroom activities , 1988 .

[8]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[9]  Patrick T. Terenzini,et al.  Assessment with open eyes: Pitfalls in studying student outcomes , 2010 .

[10]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[11]  Barbara A. Greene,et al.  Engagement in Academic Work: The Role of Learning Goals, Future Consequences, Pleasing Others, and Perceived Ability , 1996, Contemporary educational psychology.

[12]  J. Eccles,et al.  Expectancy-Value Theory of Achievement Motivation. , 2000, Contemporary educational psychology.

[13]  Lisa E. Baranik,et al.  Examining Specific Versus General Measures of Achievement Goals , 2010 .

[14]  H. M. Marks,et al.  Student Engagement in Instructional Activity: Patterns in the Elementary, Middle, and High School Years , 2000 .

[15]  K. E. Barron,et al.  Examining the Psychometric Properties of the Achievement Goal Questionnaire in a General Academic Context , 2004 .

[16]  J. Nicholls.  Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. , 1984 .

[17]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[18]  James J. Appleton,et al.  Student engagement with school: Critical conceptual and methodological issues of the construct. , 2008 .

[19]  Carol S. Dweck,et al.  Motivational processes affecting learning. , 1986 .

[20]  L. T. DeCarlo.  On the meaning and use of kurtosis. , 1997 .

[21]  Christine E. DeMars,et al.  Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions , 2005 .

[22]  James J. Appleton,et al.  Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument , 2006 .

[23]  Donna L. Sundre.  Does examinee motivation moderate the relationship between test consequences and test performance , 1999 .