A Study of Criteria Used in Equating

One aspect of the equating process that does not seem to be developed, or applied, as fully as it might be is the area of criteria. Although there are many options from which to choose, in terms of a data collection design, and the specific methodology to use, there is not much guidance in how to evaluate the options and select the best one for current needs. Thus, an investigation of the criteria proposed in the literature for a variety of situations seems useful. In the steps that need to be followed in conducting an equating, one is rarely asked to explicitly state which definition of equating will be used or how it will be determined if the methodology chosen results in an equating of adequate accuracy for one's purpose. It would seem that a good place to begin in developing equating criteria would be with the definition of equating. Thus, in addition to a section reviewing how equating criteria have been used in the equating literature, this article first approaches the topic of equating criteria fro...

[1]  Dorothy T. Thayer,et al.  SECTION PRE‐EQUATING THE GRADUATE RECORD EXAMINATIONS , 1981 .

[2]  B. Fairbank The Use of Presnloothing and Postsnloothing to Increase the Precision of Equipercentile Equating , 1987 .

[3]  Deborah J. Harris,et al.  A Comparison of Two Equipercentile Equating Methods for Common Item Equating , 1990 .

[4]  Standard Errors of Equipercentile Equating for the Common Item Nonequivalent Populations Design , 1985 .

[5]  Frederic M. Lord,et al.  Practical Applications of Item Characteristic Curve Theory. , 1977 .

[6]  Deborah J. Harris,et al.  An Application of the Three-Parameter IRT Model to Vertical Equating , 1987 .

[7]  Susan E. Holmes UNIDIMENSIONALITY AND VERTICAL EQUATING WITH THE RASCH MODEL , 1982 .

[8]  G. Skaggs To Match or Not to Match Samples on Ability for Equating: A Discussion of Five Articles , 1990 .

[9]  Martha L. Stocking,et al.  Developing a Common Metric in Item Response Theory , 1983 .

[10]  W. R. Cowell,et al.  AN EXAMINATION OF THE ASSUMPTION THAT THE EQUATING OF PARALLEL FORMS IS POPULATION‐INDEPENDENT , 1985 .

[11]  G. Masters Common-Person Equating with the Rasch Model , 1985 .

[12]  M. J. Kolen Effectiveness of Analytic Smoothing in Equipercentile Equating , 1984 .

[13]  Robert W. Lissitz,et al.  An Exploration of the Robustness of Four Test Equating Models , 1986 .

[14]  R. Mckinley,et al.  Reducing Test Form Overlap of the GRE Subject Test in Mathematics Using IRT Triple-Part Equating. GRE Board Professional Report No. 86-14P. , 1989 .

[15]  STANDARD ERROR OF AN EQUATING BY ITEM RESPONSE THEORY , 1981 .

[16]  Neil J. Dorans,et al.  THE EFFECTS OF VIOLATIONS OF UNIDIMENSIONALITY ON THE ESTIMATION OF ITEM AND ABILITY PARAMETERS AND ON ITEM RESPONSE THEORY EQUATING OF THE GRE VERBAL SCALE , 1985 .

[17]  S. Phillips Comparison of Equipercentile and Item Response Theory Equating When the Scaling Test Method Is Applied to a Multilevel Achievement Battery , 1983 .

[18]  M. J. Kolen Standard Errors of Tucker Equating , 1985 .

[19]  R. Robert Rentz,et al.  THE NATIONAL REFERENCE SCALE FOR READING: AN APPLICATION OF THE RASCH MODEL1 , 1977 .

[20]  Robert L. Linn,et al.  The Rasch Model, Objective Measurement, Equating, and Robustness , 1979 .

[21]  Linda L. Cook IRT Equating: A Flexible Alternative to Conventional Methods for Solving Practical Testing Problems. , 1981 .

[22]  R. Linn,et al.  VERTICALLY EQUATED TESTS: FACT OR PHANTOM?* , 1977 .

[23]  I. Bejar,et al.  A Study of Pre-Equating Based on Item Response Theory , 1982 .

[24]  Deborah J. Harris A Comparison of Angoff's Design I and Design II for Vertical Equating Using Traditional and IRT Methodology , 1991 .

[25]  D. Budescu EFFICIENCY OF LINEAR EQUATING AS A FUNCTION OF THE LENGTH OF THE ANCHOR TEST , 1985 .

[26]  Samuel A. Livingston,et al.  What Combination of Sampling and Equating Methods Works Best , 1989 .

[27]  N. Dorans,et al.  Checking the Statistical Equivalence of Nearly Identical Test Editions , 1990 .

[28]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[29]  H. Kelderman Common Item Equating Using the Loglinear Rasch Model , 1988 .

[30]  Frederic M. Lord,et al.  Comparison of IRT True-Score and Equipercentile Observed-Score "Equatings" , 1984 .

[31]  The Standard Error of Equipercentile Equating , 1982 .

[32]  Robert W. Lissitz,et al.  IRT Test Equating: Relevant Issues and a Review of Recent Research , 1986 .

[33]  Wendy M. Yen,et al.  Effects of Local Item Dependence on the Fit and Equating Performance of the Three-Parameter Logistic Model , 1984 .

[34]  Effect on Equating Results of Matching Samples on an Anchor Test. , 1990 .

[35]  R. Brennan,et al.  A Reply to Angoff , 1987 .

[36]  SOME RESULTS RELATING TO TEST EQUATING UNDER RELAXED TEST FORM EQUIVALENCE , 1972 .

[37]  W. M. Yen Tau-equivalence and equipercentile equating , 1983 .

[38]  Robert MacCann Derivations of Observed Score Equating Methods That Cater to Populations Differing in Ability , 1990 .

[39]  M. J. Kolen,et al.  Analytic smoothing for equipercentile equating under the common item nonequivalent populations design , 1987 .

[40]  F. Baker,et al.  A Comparison of Two Procedures for Computing IRT Equating Coefficients , 1991 .

[41]  Effect of Examinee Ability on Test Equating Invariance , 1988 .

[42]  Linda L. Cook,et al.  Irt Versus Conventional Equating Methods: A Comparative Study of Scale Stability , 1983 .

[43]  W. Angoff Technical and Practical Issues in Equating: A Discussion of Four Papers , 1987 .

[44]  Marilyn M. Hicks True Score Equating by Fixed b's Scaling: A Flexible and Stable Equating Alternative , 1983 .

[45]  Gary L. Marco,et al.  Item characteristic curve solutions to three intractable testing problems. , 1977 .

[46]  Dorothy T. Thayer,et al.  THE STANDARD ERROR OF EQUATING FOR THE KERNEL METHOD OF EQUATING SCORE DISTRIBUTIONS , 1989 .

[47]  B. Hanson A Comparison of Bivariate Smoothing Methods in Common-Item Equipercentile Equating , 1991 .

[48]  Effects of Passage and Item Scrambling on Equating Relationships , 1991 .

[49]  Deborah J. Harris,et al.  Comparison of Item Preequating and Random Groups Equating Using IRT and Equipercentile Methods , 1990 .

[50]  Neal M. Kingston,et al.  Item Location Effects and Their Implications for IRT Equating and Adaptive Testing , 1984 .

[51]  D. Budescu Selecting an Equating Method: Linear or Equipercentile? , 1987 .

[52]  Linda L. Cook,et al.  Simulation Results of Effects on Linear and Curvilinear Observed-and True-Score Equating Procedures of Matching on a Fallible Criterion , 1990 .

[53]  Quantifying Equating Errors with Item Response Theory Methods , 1985 .

[54]  D. Jarjoura,et al.  THE IMPORTANCE OF CONTENT REPRESENTATION FOR COMMON‐ITEM EQUATING WITH NONRANDOM GROUPS , 1985 .

[55]  David J. Woodruff Derivations of Observed Score Linear Equating Methods Based on Test Score Models for the Common Item Nonequivalent Populations Design , 1986 .

[56]  R. Brennan,et al.  Some Practical Issues in Equating , 1987 .

[57]  Deborah J. Harris,et al.  Effect of Examinee Group on Equating Relationships , 1986 .

[58]  AN INVESTIGATION OF THE FEASIBILITY OF APPLYING ITEM RESPONSE THEORY TO EQUATE ACHIEVEMENT TESTS1,2,3 , 1985 .

[59]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[60]  Robert MacCann A Comparison of Two Observed-Score Equating Methods That Assume Equally Reliable, Congeneric Tests , 1989 .

[61]  R. Linn,et al.  An Exploration of the Adequacy of the Rasch Model For the Problem of Vertical Equating. , 1978 .

[62]  Neal M. Kingston,et al.  Alternative Methods of Equating the GRE General Test. , 1986 .

[63]  D. Whitney,et al.  Comparison of Four Procedures for Equating the Tests of General Educational Development. , 1982 .

[64]  R. Jaeger SOME EXPLORATORY INDICES FOR SELECTION OF A TEST EQUATING METHOD , 1981 .

[65]  S. Phillips THE EFFECTS OF THE DELETION OF MISFITTING PERSONS ON VERTICAL EQUATING VIA THE RASCH MODEL , 1986 .

[66]  The Impact of Item Deletion on Equating Conversions and Reported Score Distributions. , 1986 .

[67]  M. J. Kolen Does Matching in Equating Work? A Discussion. , 1990 .

[68]  M. J. Kolen COMPARISON OF TRADITIONAL AND ITEM RESPONSE THEORY METHODS FOR EQUATING TESTS , 1981 .

[69]  Brenda H. Loyd,et al.  VERTICAL EQUATING USING THE RASCH MODEL , 1980 .

[70]  B. Hanson A Note on Levine’s Formula for Equating Unequally Reliable Tests Using Data From the Common Item Nonequivalent Groups Design , 1991 .