Una ampliación del concepto de Templete: de herramienta para desarrollar ejercicios a instrumento para regular el proceso de desarrollo de los exámenes de ciencias

We discuss the limitations and possibilities of shells (blueprints with directions for test developers intended to reduce test development costs and time). Although shells cannot be expected to generate statistically exchangeable exercises, they can generate exercises with similar structures and appearances when they are highly specific and test developers are properly trained to use them. Based on our research and experience developing a wide variety of assessments, we discuss the advantages of conceiving shells as: (a) tools for effective development of constructed-response items, (b) formal specifications of the structural properties of items; (c) task-authoring environments that help test developers standardize and simplify user (examinee) interfaces; and (d) conceptual tools that guide the process of assessment development by enabling test developers to work systematically. We also caution against possible misuses of shells.

[1]  D. Nuttall,et al.  Performance Assessment: The Message from England. , 1992 .

[2]  James G. Greeno,et al.  On The Nature of Competence: Principles for Understanding in a Domain© , 2018, Knowing, Learning, and Instruction.

[3]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[4]  Guillermo Solano-Flores,et al.  On the development and evaluation of a shell for generating science performance assessments , 1999 .

[5]  Bert F. Green,et al.  Performance assessment for the workplace , 1991 .

[6]  Wells HivelyII,et al.  A “UNIVERSE‐DEFINED” SYSTEM OF ARITHMETIC ACHIEVEMENT TESTS1 , 1968 .

[7]  R. Shavelson,et al.  Sampling Variability of Performance Assessments. , 1993 .

[8]  Stephen P. Klein,et al.  The Cost of Science Performance Assessments in Large-Scale Testing Programs , 1997 .

[9]  Derek Hodson,et al.  Assessment of practical work , 1992 .

[10]  Daniel F. McCaffrey,et al.  The Effects of Content, Format, and Inquiry Level on Science Performance Assessment Scores , 2000 .

[11]  Irvin R. Katz.  A SOFTWARE TOOL FOR RAPIDLY PROTOTYPING NEW FORMS OF COMPUTER‐BASED ASSESSMENTS , 1997 .

[12]  Antonio Bolívar Botía.  Revista Electrónica de Investigación Educativa , 2002 .

[13]  Susan R. Goldman,et al.  Evaluation of Procedure-Based Scoring for Hands-On Science Assessment , 1992 .

[14]  Steven A. Schneider,et al.  Expanding the Notion of Assessment Shell: From Task Development Tool to Instrument for Guiding the Process of Science Assessment Development , 2001 .

[15]  Pamela R. Aschbacher.  Performance Assessment: State Activity, Interest, and Concerns , 1991 .

[16]  L. Cronbach,et al.  THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY† , 1963 .

[17]  G. Solano-Flores,et al.  Item Structural Properties as Predictors of Item Difficulty and Item Association , 1993 .

[18]  L. Crocker.  Assessing Content Representativeness of Performance Assessment Exercises , 1997 .

[19]  Thomas M. Haladyna,et al.  Item Shells , 1989 .

[20]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[21]  Thomas M. Haladyna,et al.  A technology for test-item writing , 1981 .

[22]  Steven M. Downing,et al.  Test Item Development: Validity Evidence From Quality Assurance Procedures , 1997 .

[23]  Edward H. Haertel,et al.  Generalizability Analysis for Performance Assessments of Student Achievement or School Effectiveness , 1997 .

[24]  Steve A. Schneider,et al.  Management of scoring sessions in alternative assessment: the computer-assisted scoring approach , 1999, Comput. Educ..

[25]  J. Shea.  National Science Education Standards , 1995 .

[26]  Gary W. Phillips,et al.  Technical Issues in Large-Scale Performance Assessment. , 1996 .

[27]  John R. Bormuth,et al.  On the theory of achievement test items , 1970 .

[28]  R. Shavelson.  Performance Assessments: Political Rhetoric and Measurement Reality , 1992 .

[29]  J. O'neil.  Putting Performance Assessment to the Test. , 1992 .

[30]  Maria Araceli Ruiz-Primo,et al.  Note On Sources of Sampling Variability in Science Performance Assessments , 1999 .