The Design of Competency-Based Performance Assessment in E-Learning

This article focuses on the design of competency-based performance assessment in e-learning. Though effort has been invested in designing powerful e-learning environments, relatively little attention has been paid to the design of valid and reliable assessments in such environments, leaving many questions to educational developers and teachers. As a solution to this problem, a systematic approach to designing performance assessments in e-learning contexts is presented, partly based on the 4C/ID model. This model enables the construction of realistic whole tasks instead of advocating education that is restricted to more isolated skills. A new assessment procedure also implies an alternative view of instructional design, learning and assessment. The requirements for the learning environment are addressed. Examples from a virtual seminar are presented to illustrate the design approach. The article concludes with the identification of possible pitfalls related to the approach and gives directions for future research.

[1]  Brenda Johnston,et al.  Summative assessment of portfolios: an examination of different approaches to agreement over outcomes , 2004 .

[2]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[3]  Otto Jelsma,et al.  Training for reflective expertise: A four-component instructional design model for complex cognitive skills , 1992 .

[4]  Fred Lockwood.  Open and Distance Learning Today , 1995 .

[5]  Allan S. Cohen,et al.  Threats to the Valid Use of Assessments , 1996 .

[6]  J. V. van Merriënboer,et al.  The Boundary Approach of Competence: A Constructivist Aid for Understanding and Using the Concept of Competence , 2002 .

[7]  R. Shavelson.  Performance Assessment in Science , 1991 .

[8]  G. V. D. Watering.  De actuele kwaliteit van assessment: ontwikkelingen in de edumetrie , 2002 .

[9]  Richard E. Mayer,et al.  A taxonomy for computer-based assessment of problem solving , 2002, Comput. Hum. Behav..

[10]  Menucha Birenbaum,et al.  New Insights Into Learning and Teaching and Their Implications for Assessment , 2003 .

[11]  Thomas C. Reeves,et al.  Alternative Assessment Approaches for Online Learning Environments in Higher Education , 2000 .

[12]  D. Anderson,et al.  The hidden curriculum. , 1992, AJR. American journal of roentgenology.

[13]  Harold F. O'Neil,et al.  Perspectives on computer-based performance assessment of problem solving , 1999 .

[14]  Rob Martens.  The Use and Effects of Embedded Support Devices in Independent Learning. , 1998 .

[15]  Mien Segers,et al.  Influence of Redesigning a Learning Environment on Student Perceptions and Learning Strategies , 2005 .

[16]  Dominique Sluijsmans,et al.  Student involvement in assessment. The training of peer assessment skills. , 2002 .

[17]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[18]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[19]  J. Biggs.  Enhancing teaching through constructive alignment , 1996 .

[20]  Enhancing reliability in portfolio assessment: 'shaping' the portfolio , 2001, Medical teacher.

[21]  Wang Hai.  The Design and Development of Performance Assessment , 2008 .

[22]  Rob Koper,et al.  Integrated e-Learning: Implications for Pedagogy, Technology & Organization , 2005 .

[23]  Pierre Dillenbourg,et al.  What we know about CSCL and implementing it in higher education , 2004 .

[24]  Andrew S. Gibbons,et al.  Review of Web-based assessment tools , 2001 .

[25]  P. E. Mudrack,et al.  An Examination of Functional Role Behavior and Its Consequences for Individuals in Group Settings , 1995 .

[26]  C. Reich.  Peer assessment. , 1985, Canadian Medical Association journal.

[27]  Theo J. Bastiaens,et al.  The surplus value of an authentic learning environment , 2005, Comput. Hum. Behav..

[28]  A. Kennedy.  The professional development of teachers , 2008 .

[29]  E. Quellmalz.  Developing Criteria for performance Assessments: The Missing Link , 1991 .

[30]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[31]  W. James Popham,et al.  How to Prepare Students for PerEorrnance Assessments , 2005 .

[32]  Joan L. Herman,et al.  A practical guide to alternative assessment , 1992 .

[33]  Richard E. Mayer,et al.  Computer-Based Assessment of Problem Solving. , 1999 .

[34]  E. Skinner,et al.  Sense of Relatedness as a Factor in Children's Academic Engagement and Performance. , 2003 .

[35]  Richard J. Stiggins,et al.  Design and Development of Performance Assessments , 1987 .

[36]  Brenda Sugrue,et al.  Performance‐based instructional design for E‐learning , 2002 .

[37]  Randy Elliot Bennett,et al.  USING NEW TECHNOLOGY TO IMPROVE ASSESSMENT , 1999 .

[38]  Jeroen J. G. van Merriënboer,et al.  Computer-based tools for instructional design: An introduction to the special issue , 2002 .

[39]  A. Cohen,et al.  Addressing Reliability Problems in the Portfolio Assessment of College Writing , 1993 .

[40]  Jan-Willem Strijbos,et al.  Designing for interaction: Six steps to designing computer-supported group-based learning , 2004, Comput. Educ..

[41]  Theo Bastiaens,et al.  Conditions for Web-Based Learning with Real Events , 2000 .

[42]  M. Segers,et al.  Quality standards for new modes modes of assessment. An exploratory study of the consequential validity of the OverAll Test , 2001 .

[43]  D. Trauner,et al.  Behavioral Differences in School Age Children after Perinatal Stroke , 1996 .

[44]  J. Aultman.  The Hidden Curriculum , 2007 .

[45]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[46]  F. Dochy,et al.  Peer assessment in problem based learning , 2001 .

[47]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[48]  F. Prins,et al.  Formative peer assessment in a CSCL environment: a case study , 2005 .

[49]  R. Slavin.  Cooperative Learning: Theory, Research and Practice , 1990 .

[50]  Mien Segers,et al.  Optimising new modes of assessment : in search of qualities and standards , 2003 .

[51]  W. Jochems,et al.  The Effect of Functional Roles on Group Efficiency , 2004 .

[52]  Badrul H. Khan,et al.  Web-based training: an introduction , 2001 .

[53]  Beverly Abbey,et al.  网络教育 : 教学与认知发展新视角 = Instructional and Cognitive Impacts of Web -Based Education , 1999 .