Evaluation of Curricula in Higher Education

Evaluation of teaching at universities is traditionally realized in terms of student ratings. Curriculum evaluation is rarely done in a systematic manner. More often, the emphasis is placed on a particular aspect, which is only of little help in terms of modifying education. A very prominent example is that of medical education. Here, evaluations of curricula primarily focus on new curricula by contrasting them to traditional ones. The article at hand deals with a different evaluation approach, in which five phases have to be considered and contrasting results to other teaching formats are not the main focus. In this article, the authors concentrate on the first phase (baseline evaluation) of the systematic evaluation of a medical curriculum. They describe several challenges of such an evaluation approach and illustrate the strategies used to overcome them. In addition, associated relevant empirical findings from this evaluation study are presented.

[1]  J. Morrison,et al.  ABC of learning and teaching in medicine: Evaluation. , 2003, BMJ.

[2]  Michael Quinn Patton,et al.  Utilization-Focused Evaluation , 1979 .

[3]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[4]  J. Guilbert.  Comparison of the opinion of students and teachers concerning medical education programmes in Switzerland , 1998, Medical education.

[5]  D. T. Vernon,et al.  Does problem‐based learning work? A meta‐analysis of evaluative research , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[6]  J. Guilbert,et al.  The need for more efficacy and relevance in medical education , 1996, Medical education.

[7]  R. Vari,et al.  Endocrine refresher course 2001: modern medical curricula. , 2001, Advances in physiology education.

[8]  Gottfried S. Csanyi,et al.  The process of defining a profile of student competencies at the University of Vienna Medical School , 2000, Medical education.

[9]  D. Papineau,et al.  Participatory evaluation in a community organization: Fostering stakeholder empowerment and utilization , 1996 .

[10]  Tom Carney.  Fourth Generation Evaluation , 1991 .

[11]  A. Heathcote,et al.  Do junior doctors feel they are prepared for hospital practice? A study of graduates from traditional and non‐traditional medical schools , 1998, Medical education.

[12]  Ralph Reimann,et al.  Young physicians’ competences from different points of view , 2004, Medical teacher.

[13]  K. Hupfeld,et al.  Program evaluation. , 1989, NLN publications.

[14]  H. Schmidt.  Problem‐based learning: rationale and description , 1983, Medical education.

[15]  J. Verbeek,et al.  Problem based learning in continuing medical education: a review of controlled evaluation studies , 2002, BMJ : British Medical Journal.

[16]  Judith G. Calhoun,et al.  Medical students’ development of self‐ and peer‐assessment skills: A longitudinal study , 1990 .

[17]  H. Marsh.  Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness , 1984 .

[18]  Jens Nedon,et al.  Evaluation der Lehre , 1998, Informatik und Ausbildung.

[19]  H. Marsh.  Students ' Evaluations of University Teaching : Dimensionality , Reliability , Validity , Potential Biases , and Utility , 2005 .

[20]  G B Clack,et al.  Medical graduates evaluate the effectiveness of their education , 1994, Medical education.

[21]  D. Kaufman,et al.  Tutoring in problem‐based learning: a teacher development process , 1994, Medical education.

[22]  Guilbert Jj.  Comparison of the opinion of students and teachers concerning medical education programmes in Switzerland. , 1998 .

[23]  M. Hewson,et al.  What's the Use of Faculty Development? Program Evaluation Using Retrospective Self-Assessments and Independent Performance Ratings , 2001, Teaching and learning in medicine.

[24]  Martin C Michel,et al.  Comparison of problem-and lecture-based pharmacology teaching. , 2002, Trends in pharmacological sciences.

[25]  R. Hilliard.  How do medical students learn: Medical student learning styles and factors that affect these learning styles , 1995 .

[26]  J. Gordon,et al.  Clinical competence of interns , 1995 .

[27]  W. Antepohl,et al.  Problem‐based learning versus lecture‐based learning in a course of basic pharmacology: a controlled, randomized study , 1999, Medical education.

[28]  H S Barrows,et al.  A taxonomy of problem‐based learning methods , 1986, Medical education.

[29]  R. Coles.  The moral education of medical students , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[30]  H. Marsh.  Validity of Students' Evaluations of College Teaching: A Multitrait-Multimethod Analysis. , 1982 .

[31]  C P Collier,et al.  Problems Identified by Tutors in a Hybrid Problem‐based Learning Curriculum , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[32]  Wilbert J. McKeachie,et al.  Research on College Teaching: The Historical Background. , 1990 .

[33]  R. Pabst,et al.  Evaluation of the medical curriculum: why, when, by whom and for whom should questionnaires be used. , 2001, European Journal of Morphology.

[34]  D. Cook,et al.  Problem-based learning: its role in undergraduate surgical education. , 1995, Canadian journal of surgery. Journal canadien de chirurgie.

[35]  James R. Sanders,et al.  The program evaluation standards : how to assess evaluations of educational programs , 1994 .

[36]  Kenneth A. Feldman,et al.  Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers , 1989 .