Teachers' Assessment of Students' Research Skills.

Today, teachers are expected to develop complex skills, such as research skills, in their students while implementing new views on learning and teaching and using authentic assessment strategies. About these new assessment strategies there is much debate and teachers are vulnerable in using them. We studied upper secondary education natural and social science teachers' practices using two surveys and two rounds of expert panel judgement on teacher-submitted assessment-related material and information. Our study shows that there are grounds for concern regarding the clarity of teachers' assessment criteria, the consistency between teachers' goals, assignments, and criteria, and the validity and acceptability of teachers' assessment practices. The extent to which it is justifiable to judge teachers' assessment practice by professional quality criteria is discussed, and suggestions are given as to the main quality criteria for formative and summative assessment and as to ways in which teachers could improve their assessment practices.

[1]  Jamal Abedi,et al.  Dimensionality and Generalizability of Domain-Independent Performance Assessments , 1996 .

[2]  Edward H. Haertel.  Performance Assessment and Education Reform , 1999 .

[3]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[4]  Howard Gardner,et al.  To Use Their Minds Well: Investigating New Forms of Student Assessment , 1991 .

[5]  Allan S. Cohen,et al.  Threats to the Valid Use of Assessments , 1996 .

[6]  David F. Treagust,et al.  A review of teacher development reforms in Indonesian secondary science: The effectiveness of practical work in biology , 1997 .

[7]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[8]  Bronwen Cowie,et al.  A Model of Formative Assessment in Science Education , 1999 .

[9]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[10]  Edward H. Haertel.  Construct Validity and Criterion-Referenced Testing , 1985 .

[11]  Roger Lock,et al.  Assessment of Practical Skills. Part 2. Context Dependency and Construct Validity , 1990 .

[12]  J. Millman,et al.  The specification and development of tests of achievement and ability. , 1989 .

[13]  Menucha Birenbaum,et al.  Toward adaptive assessment — The student's angle , 1994 .

[14]  M. Scardamalia,et al.  Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise , 1993 .

[15]  Harvey Goldstein,et al.  The Design And Analysis Of Longitudinal Studies , 1979 .

[16]  Richard Gott,et al.  The place of investigations in practical work in the UK National Curriculum for Science , 1995 .

[17]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[18]  Edward H. Haertel.  Performance Assessment and Educational Reform. , 1999 .

[19]  Brian Gee,et al.  The Origin of Practical Work in the English School Science Curriculum. , 1992 .

[20]  Richard Gott,et al.  Practical work: its role in the understanding of evidence in science , 1996 .

[21]  Robert Glaser,et al.  Assessment, Testing, and Instruction: Retrospect and Prospect. , 1994 .

[22]  J. L. Moore,et al.  The Construct Validity and Context Dependency of Teacher Assessment of Practical Skills in Some Pre‐university Level Science Examinations , 1996 .

[23]  M. Boekaerts.  Subjective competence, appraisals and self-assessment , 1991 .

[24]  John B. Willett,et al.  Questions and Answers in the Measurement of Change , 1988 .

[25]  Michael T. Kane,et al.  An argument-based approach to validity. , 1992 .

[26]  G. Wiggins.  Assessment: Authenticity, Context, and Validity. , 1993 .

[27]  P. Moss.  Shifting Conceptions of Validity in Educational Measurement: Implications for Performance Assessment , 1992 .

[28]  T. Crooks.  The Impact of Classroom Evaluation Practices on Students , 1988 .

[29]  K. Fischer.  A theory of cognitive development: The control and construction of hierarchies of skills. , 1980 .

[30]  Ronald K. Hambleton,et al.  A Psychometric Perspective on Authentic Measurement , 1992 .

[31]  J. Willett.  Chapter 9: Questions and Answers in the Measurement of Change , 1988 .

[32]  A. Colley,et al.  Acquisition and performance of cognitive skills , 1989 .

[33]  Robert L. Linn,et al.  Performance Assessment: Policy Promises and Technical Measurement Standards , 1994 .

[34]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[35]  R. Snow,et al.  Implications of cognitive psychology for educational measurement. , 1989 .

[36]  Anthony J. Nitko,et al.  Designing tests that are integrated with instruction. , 1989 .

[37]  F. Lumley.  Measurement in Radio , 1971 .

[38]  Derek Hodson,et al.  Assessment of practical work , 1992 .

[39]  P. Alexander,et al.  Coming to Terms: How Researchers in Learning and Literacy Talk About Knowledge , 1991 .

[40]  J. Frederiksen,et al.  Inquiry, Modeling, and Metacognition: Making Science Accessible to All Students , 1998 .

[41]  Paul A. Kirschner,et al.  Practical work at the Open University of the Netherlands , 1995 .

[42]  K. Rowe,et al.  Assessing, Recording and Reporting Students’ Educational Progress: the case for ‘subject profiles’ , 1996 .

[43]  Richard J. Stiggins,et al.  THE ECOLOGY OF CLASSROOM ASSESSMENT , 1985 .

[44]  P. Kirschner.  Epistemology, practical work and Academic skills in science education , 1992 .

[45]  Joan L. Herman,et al.  Establishing Validity for Performance-Based Assessments: An Illustration for Collections of Student Writing. , 1996 .

[46]  K. Stokking,et al.  Valid Classroom Assessment of Complex Skills , 2000 .

[47]  Samuel Messick,et al.  The Psychology of Educational Measurement. , 1984 .