New Assessment Forms in Problem-based Learning: The value-added of the students' perspective

To an increasing extent, teachers and students are leaving the well-known, traditional learning and assessment avenues and moving towards new learning environments and modes of assessment. However, the road from theory to practice seems to be a rocky one. This article presents the quantitative and qualitative data gathered from a research project which focused on different quality aspects of two new assessment forms in problem-based learning. A written examination was used to assess the extent to which students are able to define, analyse and solve novel, authentic problems. Peer assessment was introduced for students to report on collaborative work during the tutorial meeting, and during the study period that follows these weekly meetings. Students' perceptions are used as a tool for explaining the strengths and weaknesses of both instruments and the learning environment in which they are embedded. The article suggests that both assessment forms have acceptable qualities. The written examination seems to have an acceptable curricular, instructional and criterion validity. For the peer assessment, generalisability coefficients for both groups were over 0.75. Peer assessment seems to be accurate. Peer marks seem to correlate well with tutor marks and final examination scores. However, the students' learning outcomes, as measured by the examination, are lower than expected. Staff members experience the students' learning activities as disappointing. In the Louvain case, there are indications that the students cannot accurately reflect on their own functioning. In order to highlight plausible explanations, students' perceptions of the learning-assessment environment are analysed. In both cases, students perceive a gap between their working in the tutorial groups and the assessment. These results offer a valuable input for teachers to formulate concrete recommendations for optimising their educational and assessment practices.

[1]  Michiel R. Leenders,et al.  Case research: the case writing process , 1989 .

[2]  Interactions of study orientation and students' appreciation of structure in their educational environment , 1991 .

[3]  R. Shavelson,et al.  On the Content Validity of Performance Assessments: Centrality of Domain Specification , 1996 .

[4]  Robert Glaser,et al.  Assessment, Testing, and Instruction: Retrospect and Prospect. , 1994 .

[5]  M. Peters Student Attitudes to Alternative Forms of Assessment and to Openness. , 1996 .

[6]  D. Sluijsmans,et al.  The use of self-, peer and co-assessment in higher education: A review , 1999 .

[7]  Gail P. Baxter,et al.  Science performance assessments: benchmarks and surrogates , 1994 .

[8]  Problem-Solving And Assessment The Maastricht Experiences , 1995 .

[9]  Lin Norton,et al.  Self-Assessment in Coursework Essays. , 1997 .

[10]  Nancy Falchikov,et al.  PRODUCT COMPARISONS AND PROCESS BENEFITS OF COLLABORATIVE PEER GROUP AND SELF ASSESSMENTS , 1986 .

[11]  D. Boud,et al.  Quantitative studies of student self-assessment in higher education: a critical analysis of findings , 1989 .

[12]  W. Burnett,et al.  Peer Assessment by Fifth Year Students of Surgery. , 1980 .

[13]  D. Anderson,et al.  The hidden curriculum. , 1992, AJR. American journal of roentgenology.

[14]  Mien Segers,et al.  An Alternative for Assessing Problem-Solving Skills: The Overall Test. , 1997 .

[15]  H S Barrows,et al.  A taxonomy of problem‐based learning methods , 1986, Medical education.

[16]  A. Baratta,et al.  Guest editor preface , 1998 .

[17]  Edward H. Haertel Chapter 1: New Forms of Teacher Assessment , 1991 .

[18]  David Boud,et al.  Enhancing learning through self assessment , 1995 .

[19]  J. Frederiksen,et al.  A Systems Approach to Educational Testing , 1989 .

[20]  Mien S. R. Segers,et al.  Assessment in a Problem-Based Economics Curriculum , 1996 .

[21]  Liz McDowell,et al.  The construction of the hidden curriculum: messages and meanings in the assessment of student learning , 1998 .

[22]  Edward H. Haertel New Forms of Teacher Assessment , 1991 .

[23]  J. Biggs Student Approaches to Learning and Studying , 1987 .

[24]  Menucha Birenbaum,et al.  Alternatives in Assessment of Achievements, Learning Processes, and Prior Knowledge , 1996 .

[25]  F. Dochy,et al.  Assessment as a tool for learning , 1997 .

[26]  M. Birenbaum Assessment 2000: Towards a Pluralistic Approach to Assessment , 1996 .

[27]  E. G. Flaherty The Thinking Aloud Technique and Problem Solving Ability , 1975 .

[28]  Noel Entwistle,et al.  Identifying students at risk through ineffective study strategies , 1996 .