Validity: on the meaningful interpretation of assessment data

Context  All assessments in medical education require evidence of validity to be interpreted meaningfully. In contemporary usage, all validity is construct validity, which requires multiple sources of evidence; construct validity is the whole of validity, but has multiple facets. Five sources – content, response process, internal structure, relationship to other variables and consequences – are noted by the Standards for Educational and Psychological Testing as fruitful areas to seek validity evidence.

[1]  Samuel Messick,et al.  STANDARDS OF VALIDITY AND THE VALIDITY OF STANDARDS IN PERFORMANCE ASSESSMENT , 2005 .

[2]  Tony C. M. Lam,et al.  Assessing Differential Item Functioning in Performance Assessment: Review and Recommendations. , 2005 .

[3]  Allan S. Cohen,et al.  Validating Measures of Performance , 2005 .

[4]  Keith Postlethwaite,et al.  Simulation in clinical learning , 2003, Medical education.

[5]  Steven M Downing,et al.  Item response theory: applications of modern test theory in medical education , 2003, Medical education.

[6]  J. Norcini,et al.  Setting standards on educational tests , 2003, Medical education.

[7]  R. Hambleton,et al.  Quality Assurance Methods for Performance-Based Assessments , 2003, Advances in health sciences education : theory and practice.

[8]  Brian Jolly,et al.  Generalisability: a key to unlock professional assessment , 2002, Medical education.

[9]  Brian Jolly,et al.  Assessing health professionals , 2002, Medical education.

[10]  Michael C. Rodriguez,et al.  A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment , 2002 .

[11]  M. Kane Current Concerns in Validity Theory , 2001 .

[12]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[13]  Ronald K. Hambleton,et al.  Item Response Theory: Brief History, Common Models, and Extensions , 1997 .

[14]  K. Abromeit Music Received , 2023, Notes.

[15]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[16]  M. Kane,et al.  Validating Interpretive Arguments for Licensure and Certification Examinations , 1994, Evaluation & the health professions.

[17]  H. Wainer,et al.  Differential item functioning , 1995 .

[18]  D. Lohman Teaching and Testing to Develop Fluid Abilities , 1993 .

[19]  Michael T. Kane,et al.  An argument-based approach to validity. , 1992 .

[20]  M. Kane The Argument-Based Approach to Validation , 1990 .

[21]  R. Linn Educational measurement, 3rd ed. , 1989 .

[22]  M. J. Subkoviak A Practitioner's Guide to Computation and Interpretation of Reliability Indices for Mastery Tests , 1988 .

[23]  L. Cronbach Five perspectives on the validity argument. , 1988 .

[24]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[25]  Samuel Messick,et al.  The Psychology of Educational Measurement. , 1984 .

[26]  D. Newble,et al.  The effect of assessments and examinations on the learning of medical students , 1983, Medical education.

[27]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[28]  J. Loevinger Objective Tests as Instruments of Psychological Theory , 1957 .

[29]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.