Assessment Practices and Students Knowledge Profiles in a Problem-based Curriculum

Since the mid-1980s, many new terms have enriched the assessment literature, such as performance assessment, authentic assessment, direct assessment and curriculum-embedded assessment. This boom is a result of changes in instructional as well as in assessment approaches. Criteria for good instruction as well as good assessment practices are suggested, derived from research-based models in the field of cognitive psychology and expert-novice studies. This article first reports on the translation of these criteria into a set of the characteristics of the assessment system of a problem-based curriculum in the field of Economics and Business Administration. Secondly, the article reports a study on improving assessment practices. Is it important to map students' knowledge profiles when attempting to remediate problem-solving performances? The answer to this question depends on the extent to which a student's problem-solving performance is influenced by the quality of his/her knowledge profile. Students' knowledge profile is measured by a Knowledge Test and a Sorting Task. Students' problem-solving skills are assessed by an Overall Test. The results indicate that students with an organised knowledge base perform better in problem-solving situations than students whose conceptual models are loosely structured. The implications of these findings for instruction as well as for assessment are discussed.

[1]  Gail P. Baxter,et al.  Science performance assessments: benchmarks and surrogates , 1994 .

[2]  Alan H. Schoenfeld,et al.  Mathematical Problem Solving , 1985 .

[3]  R. Glaser.  Expert knowledge and processes of thinking , 1992 .

[4]  S H Shahabudin,et al.  Content coverage in problem‐based learning , 1987, Medical education.

[5]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[6]  Howard Gardner,et al.  To Use Their Minds Well: Investigating New Forms of Student Assessment , 1991 .

[7]  Howard Gardner,et al.  Chapter 2: To Use Their Minds Well: Investigating New Forms of Student Assessment , 1991 .

[8]  Morris Feller,et al.  Open-Book Testing and Education for the Future. , 1994 .

[9]  A. Baratta,et al.  Guest editor preface , 1998 .

[10]  F. Dochy.  Investigating the Use of Knowledge Profiles in a Flexible Learning Environment: Analyzing Students’ Prior Knowledge States , 1994 .

[11]  Ronald K. Hambleton,et al.  A Psychometric Perspective on Authentic Measurement , 1992 .

[12]  Patricia A. Alexander,et al.  Mapping prior knowledge: A framework for discussion among researchers , 1995 .

[13]  James W. Pellegrino,et al.  Cognitive correlates and components in the analysis of individual differences , 1979 .

[14]  Charles A. Letteri.  Cognitive Profile: Basic Determinant of Academic Achievement , 1980 .

[15]  R. Shavelson,et al.  On the Content Validity of Performance Assessments: Centrality of Domain Specification , 1996 .

[16]  Interactions of study orientation and students' appreciation of structure in their educational environment , 1991 .

[17]  Ann L. Brown.  Learning, remembering, and understanding , 1982 .

[18]  John R. Anderson.  The Architecture of Cognition , 1983 .

[19]  Paul J. Feltovich,et al.  Learning, Teaching and Testing for Complex Conceptual Understanding. , 1991 .

[20]  Robert Glaser,et al.  Assessment, Testing, and Instruction: Retrospect and Prospect. , 1994 .

[21]  LEARNING ECONOMICS IN HIGHER EDUCATION: AN INVESTIGATION CONCERNING THE QUALITY AND IMPACT OF EXPERTISE , 1991 .

[22]  R. Shavelson.  Methods for examining representations of A subject-matter structure in a student's memory , 1974 .

[23]  R. Tamblyn,et al.  Problem-based learning : an approach to medical education , 1980 .

[24]  Ning Wang,et al.  Validating the cognitive complexity and content quality of a mathematics performance assessment , 1994 .

[25]  Mike U. Smith.  Toward a unified theory of problem solving : views from the content domains , 1993 .

[26]  Diana H. J. M. Dolmans,et al.  How students learn in a problem-based curriculum , 1994 .

[27]  Robert J. Mislevy,et al.  New Views of Student Learning: Implications for Educational Measurement. , 1991 .

[28]  M. Birenbaum.  Assessment 2000: Towards a Pluralistic Approach to Assessment , 1996 .

[29]  James F. Voss,et al.  Text Processing of Domain-Related Information for Individuals with High and Low Domain Knowledge: Methodological Considerations. , 1979 .