TASK SPECIFICATION CHART: A KEY TO A BETTER UNDERSTANDING OF TEST RESULTS

A task specification chart (TSC) that integrates the content facets and the procedural steps of a specified task is suggested as a tool for designing a test and for interpreting its results. An instructional unit for adding and subtracting fractions was used to demonstrate the design and application of the TSC. To evaluate its efficacy, a test based on the TSC was administered to two independent samples. Accounts of the variance of item difficulty indices and errors in students’ responses were used as the criteria for this evaluation. The results indicated that a very high percentage of variance in item difficulty indices was accounted for by item characteristics representing different task components. The typology of errors constructed on the basis of the TSC proved to be an efficient tool for identifying erroneous rules of operation underlying students' response patterns on the test.

[1]  Gaea Leinhardt,et al.  Overlap: What's Tested, What's Taught?. , 1981 .

[2]  G. Madaus.  The Courts, Validity and Minimum Competency Testing , 1982 .

[3]  K. Tatsuoka,et al.  ON THE DIMENSIONALITY OF ACHIEVEMENT TEST DATA , 1982 .

[4]  Herbert P. Ginsburg,et al.  The development of mathematical thinking , 1983 .

[5]  Eva L. Baker,et al.  TASK STRUCTURE DESIGN: BEYOND LINKAGE* , 1983 .

[7]  R. Linn.  TESTING AND INSTRUCTION: LINKS AND DISTINCTIONS , 1983 .

[8]  William H. Schmidt,et al.  CONTENT BIASES IN ACHIEVEMENT TESTS , 1983 .

[9]  D. Harnisch.  ITEM RESPONSE PATTERNS: APPLICATIONS FOR EDUCATIONAL PRACTICE , 1983 .

[10]  R. Glaser,et al.  The Future of Testing: A Research Agenda for Cognitive Psychology and Psychometrics. , 1981 .

[11]  L. Brueckner.  Analysis of Errors in Fractions , 1928, The Elementary School Journal.

[12]  Eva L. Baker,et al.  Educational testing and evaluation : design, analysis, and policy , 1980 .

[13]  Kikumi K. Tatsuoka,et al.  Spotting Erroneous Rules of Operation by the Individual Consistency Index. , 1983 .

[14]  Terrence G. Coburn,et al.  Using research in teaching: Notes from National Assessment: addition and multiplication with fractions , 1976 .

[15]  Kikumi K. Tatsuoka,et al.  A Comparative Analysis of Two Order Analytic Techniques: Assessing Item Hierarchies in Real and Simulated Data. , 1983 .

[16]  Mary S. Riley,et al.  Development of Children's Problem-Solving Ability in Arithmetic. , 1984 .

[17]  Kikumi K. Tatsuoka,et al.  Analysis of Errors in Fraction Addition and Subtraction Problems. Final Report. , 1984 .