Item Banking with Embedded Standards

An item banking method that does not use Item Response Theory (IRT) is described. This method provides a comparable grading system across schools that would be suitable for low-stakes testing. It uses the Angoff standard-setting method to obtain item ratings that are stored with each item. An example of such a grading system is given, showing how a grade and a scaled score could be calculated for a particular student.

[1]  Judy A. Shea,et al.  The Effect of Various Factors on Standard Setting. , 1988 .

[2]  Jill Burstein,et al.  AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0 , 2004 .

[3]  THEUSEFULNESS OFITEMBANKS ITEM BANKING , .

[4]  John D'Arcy,et al.  Setting Reliable National Curriculum Standards: a guide to the Angoff procedure , 1994 .

[5]  Ronald A. Berk,et al.  Standard Setting: The Next Generation (Where Few Psychometricians Have Gone Before!) , 1996 .

[6]  W. James Popham,et al.  AS ALWAYS, PROVOCATIVE , 1978 .

[7]  James C. Impara,et al.  A COMPARISON OF THREE METHODS FOR ESTABLISHING MINIMUM STANDARDS ON THE NATIONAL TEACHER EXAMINATIONS , 1984 .

[8]  Some factors which influence the facility index of objective test items in school chemistry , 1980 .

[9]  R. Jaeger,et al.  Influence of Type of Judge, Normative Information, and Discussion on Standards Recommended for the National Teacher Examinations , 1990 .

[10]  Richard M. Jaeger,et al.  An Iterative Structured Judgment Process for Establishing Standards on Competency Tests: Theory and Application , 1982 .

[11]  Jill Burstein,et al.  The E-rater® scoring engine: Automated essay scoring with natural language processing. , 2003 .

[12]  Samuel T. Mayo,et al.  Statistical methods in education and psychology , 1979 .

[13]  Relations Between Observed Item Difficulty Levels and Angoff Minimum Passing Levels for a Group of Borderline Examinees , 1999 .

[14]  R. Linn Educational measurement, 3rd ed. , 1989 .

[15]  Leonard S. Cahen,et al.  Educational Testing Service , 1970 .

[16]  R. Linn DEMANDS, CAUTIONS, AND SUGGESTIONS FOR SETTING STANDARDS , 1978 .

[17]  Rebecca S. Lipner,et al.  A Comparison of Three Variations on a Standard-Setting Method. , 1987 .

[18]  Isaac I. Bejar,et al.  Subject Matter Experts' Assessment of Item Statistics , 1981 .