IRT Test Assembly Using Network-Flow Programming

The use of mathematical programming techniques to generate parallel test forms with passages and item characteristics based on item response theory was investigated, using the Fundamentals of Engineering Examination. The problem of creating one test form is modeled as a network-flow problem with additional constraints. This formulation is then used in a heuristic assembly of several parallel forms. The network-flow problem is solved with a special-purpose combinatorial polynomial algo-rithm. The non-network constraints are handled using Lagrangian relaxation and heuristic search techniques. From an item bank with almost 1,100 items, four parallel test forms with 157 items each were generated in 3 minutes. The results of the math-ematical programming approach were compared with human-generated forms. It was concluded that the mathematical programming approach can produce test forms of the same quality as those produced entirely by human effort.

[1]  T. Theunissen.  Some Applications of Optimization Algorithms in Test Design and Adaptive Testing , 1986 .

[2]  T. Theunissen.  Binary programming and test design , 1985 .

[3]  B. Barmish,et al.  Item Characteristics of Tests Constructed by Linear Programming , 1988 .

[4]  Ronald D. Armstrong,et al.  An automated test development of parallel tests from a seed test , 1992 .

[5]  Harvey Weiss,et al.  A Mathematical Programming Model for Test Construction and Scoring , 1973 .

[6]  Ellis L. Johnson,et al.  Solving Large-Scale Zero-One Linear Programming Problems , 1983, Oper. Res..

[7]  J. Shapiro.  A Survey of Lagrangian Techniques for Discrete Optimization. , 1979 .

[8]  W. D. Linden,et al.  Achievement test construction using 0-1 linear programming , 1991 .

[9]  W. D. Linden,et al.  A maximin model for IRT-based test design with practical constraints , 1989 .

[10]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[11]  Ellen Boekkooi-Timminga.  Simultaneous test construction by zero-one programming , 1986 .

[12]  Marshall L. Fisher,et al.  An Applications Oriented Guide to Lagrangian Relaxation , 1985 .

[13]  Ellen Boekkooi-Timminga,et al.  A Cluster-Based Method for Test Construction , 1990 .

[14]  Ronald K. Hambleton,et al.  Applications of Item Response Theory , 1983 .

[15]  Karen Draney,et al.  Objective measurement : theory into practice , 1992 .

[16]  D. F. Votaw.  Methods of solving some personnel-classification problems , 1952 .

[17]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.