Enhancing the Validity and Usefulness of Large-Scale Educational Assessments: II. NELS:88 Science Achievement

This study is second in a series demonstrating that achievement tests are multidimensional and that using psychologically meaningful subscores in national educational surveys can enhance test validity and usefulness. NELS:88 8th- and l0th-grade science tests were subjected to full information item factor analysis. Factors reflecting everyday knowledge, scientific reasoning, chemistry knowledge, and reasoning with knowledge were obtained in 8th grade. Quantitative science, spatial-mechanical, and basic knowledge and reasoning were distinguishable factors in 10th grade. Regression analyses showed that different patterns of prior math and science achievement, and of course taking, were associated with each l0th-grade science factor. Teacher emphasis on problem solving and understanding related more to quantitative science, and basic knowledge and reasoning. Spatial-mechanical reasoning showed the strongest gender and ethnicity effects; it related also to science museum visits but not to instructional variables. It is recommended that multidimensional achievement scores be used to capture student and teacher effects that total scores used alone miss.

[1]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[2]  Donald A. Rock,et al.  Psychometric Report for the NELS:88 Base Year Test Battery. Contractor Report. Technical Report. , 1991 .

[3]  R. Shavelson.  Performance Assessment in Science , 1991 .

[4]  Eugene G. Johnson.  Technical Report of the NAEP 1992 Trial State Assessment Program in Mathematics. , 1993 .

[5]  Richard J. Shavelson,et al.  Indicators for Monitoring Mathematics and Science Education , 1989 .

[6]  Haggai Kupermintz,et al.  Enhancing the Validity and Usefulness of Large-Scale Educational Assessments: III. NELS: 88 Mathematics Achievement to 12th Grade , 1997 .

[7]  William Stout,et al.  A nonparametric approach for assessing latent trait unidimensionality , 1987 .

[8]  S. Heyneman,et al.  Influences on Academic Achievement Across High and Low Income Countries: A Re-Analysis of IEA Data. , 1982 .

[9]  E. Muraki,et al.  Full-Information Item Factor Analysis , 1988 .

[10]  Ronald K. Hambleton,et al.  A Psychometric Perspective on Authentic Measurement , 1992 .

[11]  Martin L. Maehr,et al.  Gender Differences in Motivational Orientations Toward Achievement in School Science: A Quantitative Synthesis , 1984 .

[12]  R. Snow,et al.  In Dedication: Leigh Burstein , 1995 .

[13]  Ronald E. Anderson,et al.  The Effects of Schooling on Mathematics Achievement , 1982 .

[14]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[15]  Senta A. Raizen,et al.  Indicators of Precollege Education in Science and Mathematics, A Preliminary Review. , 1987 .