Parameter Estimation Using Multiple Matrix Sampling: Simulated Versus Empirical Data Results

AbstractMonte Carlo studies offer the opportunity to manipulate data sets with specified characteristics and to examine the generalizability of statistical procedures in ways that are not practical using actual (empirical) data. To determine whether computer-generated (simulated) data results accurately represent empirical data, this study replicated an investigation of the effects of item sampling plans in the application of multiple matrix sampling using both simulated and empirical data sets. Although results were similar, the empirical data results were more precise. This study suggests that, for some investigations, it may be important to confirm simulated study with empirical study.

[1]  R. O’brien,et al.  A General ANOVA Method for Robust Tests of Additive Models for Variances , 1979 .

[2]  L. S. Feldt,et al.  An Examination of the Context Effect in Item Sampling. , 1974 .

[3]  James Algina,et al.  Type I Error Rates and Power Estimates of Selected Parametric and Nonparametric Tests of Scale , 1987 .

[4]  N. J. Myerberg.  The Effect of Item Stratification on the Estimation of the Mean and Variance of Universe Scores in Multiple Matrix Sampling , 1979 .

[5]  R. Garg,et al.  A COMPARISON OF EXAMINEE SAMPLING AND MULTIPLE MATRIX SAMPLING IN TEST DEVELOPMENT , 1986 .

[6]  D. M. Shoemaker.  AN APPLICATION OF ITEM-EXAMINEE SAMPLING TO SCALING ATTITUDES , 1971 .

[7]  Leigh Burstein,et al.  Instructionally Sensitive Psychometrics: Application of a New IRT‐Based Detection Technique to Mathematics Achievement Test Items , 1991 .

[8]  R. Barcikowski.  A MONTE CARLO STUDY OF ITEM SAMPLING (VERSUS TRADITIONAL SAMPLING) FOR NORM CONSTRUCTION1 , 1972 .

[9]  R. O’brien,et al.  A simple test for variance effects in experimental designs. , 1981 .

[10]  R. Barcikowski.  The Effects of Item Discrimination on the Standard Errors of Estimate Associated with Item-Examinee Sampling Procedures , 1974 .

[11]  Ken Sirotnik.  AN INVESTIGATION OF THE CONTEXT EFFECT IN MATRIX SAMPLING1 , 1970 .

[12]  Standard Errors of Estimate in Item-Examinee Sampling as a Function of Test Reliability, Variation in Item Difficulty Indices and Degree of Skewness in the Normative Distribution , 1972 .

[13]  B. Loyd,et al.  A Comparison of Item Sampling Plans in the Application of Multiple Matrix Sampling , 1991 .

[14]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[15]  R. Barcikowski,et al.  Item Sampling: Optimal Number of People and Items , 1974 .

[16]  Fn Kerlinger,et al.  Foundations of behavioral research (2nd ed. , 1973 .

[17]  David M. Shoemaker,et al.  ITEM‐EXAMINEE SAMPLING PROCEDURES AND ASSOCIATED STANDARD ERRORS IN ESTIMATING TEST PARAMETERS , 1970 .