Patterns of Diagnosed Mathematical Content and Process Skills in TIMSS-R Across a Sample of 20 Countries

This study used a diagnostic testing approach to compare the mathematics achievement of eighth-grade students across a sample of 20 countries, analyzing data from the Third International Math and Science Study–Revised (TIMSS-R, 1999). Using the rule-space method, student mastery was measured on 23 specific content knowledge and processing subskills (“attributes”) underlying students’ item scores, using 23 attributes previously defined and validated. Mean mastery levels for each attribute were compared for the 20 selected countries. Clear differences among the countries were found in patterns of subskill achievement. U.S. students were strong in some content and quantitative reading skills, but weak in others, notably geometry. Interestingly, success in geometry was found to be highly associated with logical reasoning and other important mathematical thinking skills across the sampled countries.

[1]  D. Pfeffermann,et al.  Small area estimation , 2011 .

[2]  DAVID G. KENDALL,et al.  Introduction to Mathematical Statistics , 1947, Nature.

[3]  Gundel Schümer.  Mathematics Education in Japan. , 1999 .

[4]  J. Stigler,et al.  The TIMSS Videotape Classroom Study: Methods and Findings from an Exploratory Research Project on Eighth-Grade Mathematics Instruction in Germany, Japan, and the United States. A Research and Development Report. , 1999 .

[5]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[6]  I. Kostin,et al.  The Subskills of Reading: Rule‐space Analysis of a Multiple‐choice Test of Second Language Reading Comprehension , 1997 .

[7]  Kikumi K. Tatsuoka,et al.  Boolean Algebra Applied to Determination of Universal Set of Knowledge States , 1991 .

[8]  J. Stigler,et al.  A Proposal for Improving Classroom Teaching: Lessons from the TIMSS Video Study , 2000, The Elementary School Journal.

[9]  Thomas S. Ferguson,et al.  Sequential classification on partially ordered sets , 2003 .

[10]  William H. Schmidt,et al.  A splintered vision : an investigation of U.S. science and mathematics education , 1997 .

[11]  H. Meserve.  Understanding understanding , 2005, Journal of Religion and Health.

[12]  Kikumi K. Tatsuoka,et al.  Differential Item Functioning Resulting From The Use of Different Solution Strategies , 1988 .

[13]  Kikumi K. Tatsuoka,et al.  Bug Distribution and Pattern Classification. , 1985 .

[14]  Curtis Tatsuoka,et al.  Data analytic methods for latent partially ordered classification models , 2002 .

[15]  Diana Lambdin Kroll,et al.  An Overview of Research on Cooperative Learning Related to Mathematics. , 1991 .

[16]  Walter J. Schneider,et al.  Introduction to Connectionist Modeling in Education , 1992 .

[17]  M. Pressley,et al.  Cognition, Teaching, and Assessment , 1995 .

[18]  David F. Robitaille,et al.  National contexts for mathematics and science education : an encyclopedia of the education sustems participating in TIMSS , 1997 .

[19]  Kikumi Tatasuoka.  Use of Generalized Person-Fit Indexes, Zetas for Statistical Pattern Classification. , 1996 .

[20]  D. Macnab.  Implementing change in mathematics education , 2003 .

[21]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[22]  Kikumi K. Tatsuoka,et al.  Architecture of knowledge structures and cognitive diagnosis: A statistical pattern recognition and classification approach. , 1995 .

[23]  Kikumi K. Tatsuoka,et al.  A Probabilistic Model for Diagnosing Misconceptions By The Pattern Classification Approach , 1985 .

[24]  James W. Stigler,et al.  Teachers' Use of Questions in Eighth-Grade Mathematics Classrooms in Germany, Japan, and the United States. , 1999 .

[25]  Kikumi K. Tatsuoka,et al.  Bug distribution and statistical pattern classification , 1987 .

[26]  Cornelis A.W. Glas,et al.  A Bayesian Approach to Person Fit Analysis in Item Response Theory Models , 2003 .

[27]  W. Stout.  Psychometrics: From practice to theory and back , 2002 .

[28]  Russell G. Almond,et al.  DESIGN AND ANALYSIS IN A COGNITIVE ASSESSMENT , 2003 .

[29]  D. Macnab.  Raising standards in mathematics education: values, vision, and TIMSS , 2000 .

[30]  Kikumi K. Tatsuoka,et al.  Computerized Cognitive Diagnostic Adaptive Testing: Effect on Remedial Instruction as Empirical Validation , 1997 .

[31]  Robert J. Mislevy,et al.  Test Theory for A New Generation of Tests , 1994 .

[32]  Robert J. Marzano,et al.  Dimensions of Thinking: A Framework for Curriculum and Instruction , 1988 .

[33]  K. Tatsuoka,et al.  Application of the rule-space procedure to language testing: examining attributes of a free response listening test , 1998 .

[34]  James G. Greeno,et al.  Number sense as situated knowing in a conceptual domain , 1990 .

[35]  Subgroup Differences on the GRE Quantitative Test Based on the Underlying Cognitive Processes and Knowledge , 2000 .

[36]  H. Stevenson,et al.  Motivation and mathematics achievement: a comparative study of Asian-American, Caucasian-American, and east Asian high school students. , 1995, Child development.

[37]  S. Chipman,et al.  Cognitively diagnostic assessment , 1995 .

[38]  J. Corter,et al.  An Efficient Metric Combinatorial Algorithm for Fitting Additive Trees. , 1998, Multivariate behavioral research.

[39]  Ernest T. Pascarella,et al.  How college affects students , 1991 .

[40]  William H. Schmidt,et al.  Facing the Consequences: Using TIMSS for a Closer Look at U.S. Mathematics and Science Education , 1999 .

[41]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[42]  G. Jasso.  Review of "International Encyclopedia of Statistical Sciences, edited by Samuel Kotz, Norman L. Johnson, and Campbell B. Read, New York, Wiley, 1982-1988" , 1989 .