Student Assessment Precision in Mechanical Engineering Courses

Student performance on mid-term quizzes and final examinations was compared for several core undergraduate courses. A statistical comparison of the grades of students on these two tests showed only a modest correlation between grades. The modest correlation may be attributed to several factors: inaccurate grading of examinations, differences in the material tested on the mid-terms and finals, and sampling error due to the small numbers of questions on examinations. Evidence is presented that sampling error is the primary source of the low correlations. In practice, the modest correlations of mid-term quiz and final examination grades imply that the grades assigned to students are some aggregate of a true measure of the ability of students and randomness. The randomness arises because the instructor selects a particular subset of the course material for examination, not complete coverage of the course by question of all levels of difficulty.

[1]  Johanna E. Nilsson The GRE and the GMAT: A Comparison of their Correlations to GGPA , 1995 .

[2]  M. Rapport,et al.  Teacher Ratings of Academic Skills: The Development of the Academic Performance Rating Scale , 1991 .

[3]  Edith L Goldberg,et al.  Assessing the Validity of the Gre for Students in Psychology: A Validity Generalization Approach , 1992 .

[4]  ASSESSING THE RELIABILITY OF TESTS USED TO MAKE PASS/FAIL DECISIONS , 1979 .

[5]  Linda C. Strauss,et al.  Comparing Student Performance and Growth in 2- and 4-Year Institutions , 2002 .

[6]  Sarah A. Hezlett,et al.  A comprehensive meta-analysis of the predictive validity of the graduate record examinations: implications for graduate student selection and performance. , 2001, Psychological bulletin.

[7]  Charles Lewis,et al.  Estimating the Consistency and Accuracy of Classifications Based on Test Scores , 1993 .

[8]  Ronald K. Hambleton,et al.  Reliability of Credentialing Examinations and the Impact of Scoring Models and Standard-Setting Policies , 1997 .

[9]  Jonathan Baron,et al.  Sats, Achievement Tests, and High-School Class Rank as Predictors of College Performance , 1992 .

[10]  Kadriye Ercikan,et al.  Classification Accuracy of Assigning Student Performance to Proficiency Levels: Guidelines for Assessment Design , 2002 .

[11]  E. Cohn,et al.  Determinants of Undergraduate GPAs: SAT Scores, High-School GPA and High-School Rank. , 2004 .

[12]  Using the SAT and Noncognitive Variables to Predict the Grades and Retention of Asian American University Students. , 1994 .