Criterion-Referenced Assessment†

This entry provides an introduction to criterion-referenced testing and approaches for resolving several technical problems. Several of the important differences between norm-referenced testing and criterion-referenced testing will be introduced first. Next, the challenge of setting performance standards on criterion-referenced tests and several of the methods will be discussed. Finally, approaches for estimating decision consistency and decision accuracy from single and double test administrations are described. Keywords: criterion-referenced testing; criterion-referenced assessment; competency tests; performance standards; decision consistency; decision accuracy

[1]  Robert Glaser,et al.  Instructional technology and the measurement of learing outcomes: Some questions. , 1963 .

[2]  H. Huynh ON THE RELIABILITY OF DECISIONS IN DOMAIN‐REFERENCED TESTING , 1976 .

[3]  M. J. Subkoviak ESTIMATING RELIABILITY FROM A SINGLE ADMINISTRATION OF A CRITERION-REFERENCED TEST* , 1976 .

[4]  Charles Lewis,et al.  Estimating the Consistency and Accuracy of Classifications Based on Test Scores , 1993 .

[5]  Ronald K. Hambleton,et al.  Reliability of Credentialing Examinations and the Impact of Scoring Models and Standard-Setting Policies , 1997 .

[6]  F. Lord A strong true-score theory, with applications. , 1965, Psychometrika.

[7]  R. Brennan,et al.  An Investigation of Classification Consistency Indexes Estimated Under Alternative Strong True Score Models , 1990 .

[8]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[9]  R. Hambleton,et al.  ANALYSIS OF EMPIRICAL DATA USING TWO LOGISTIC LATENT TRAIT MODELS , 1973 .

[10]  Ronald K. Hambleton,et al.  A BAYESIAN DECISION-THEORETIC PROCEDURE FOR USE WITH CRITERION-REFERENCED TESTS1 , 1975 .

[11]  Ronald K. Hambleton,et al.  TOWARD AN INTEGRATION OF THEORY AND METHOD FOR CRITERION-REFERENCED TESTS1,2 , 1973 .

[12]  R. Hambleton,et al.  Setting Performance Standards on Complex Educational Assessments , 2000 .

[13]  Ronald K. Hambleton,et al.  RELIABILITY OF CRITERION‐REFERENCED TESTS: A DECISION‐THEORETIC FORMULATION , 1974 .

[14]  T. R. Husek,et al.  IMPLICATIONS OF CRITERION‐REFERENCED MEASUREMENT1,2 , 1969 .