Development and evaluation of computer‐assisted assessment in higher education in relation to BS7988

A university‐wide project team of academic and administrative staff worked together to prepare, deliver and evaluate a number of diagnostic, formative and summative computer‐based assessments. The team also attempted to assess the University of Southampton's readiness to deliver computer‐assisted assessment (CAA) within the Code of practice for the use of information technology in the delivery of assessments (British Standards Institution, 2002). Evaluation data was used formatively to improve procedures during the project and summatively in preparing the project's final report, this publication and future support for CAA at Southampton. Some of the problems encountered during this pilot programme were anticipated, both by the project team and by BS7988; but they were not necessarily or entirely avoidable given the nature of control and management in an academic environment. Our approach was to encourage institutional learning via extensive dissemination and discussion of the results. To contribute to the public debate on the adoption of BS7988, we highlight difficulties in allocating responsibility for various aspects of the assessment process and make a number of recommendations about this and other practical issues.

[1]  Joanna Bull,et al.  A Blueprint for Computer-Assisted Assessment , 2003 .

[2]  Ian A. Harwood,et al.  Thinking the unthinkable: using project risk management when introducing computer-assisted assessments , 2004 .

[3]  Daniel Nichols,et al.  Using Question Mark Perception v3 for testing mathematics , 2002 .

[4]  Gráinne Conole,et al.  CAA in UK HEIs – the state of the art? , 2003 .

[5]  Karen Fill,et al.  Assessing the contribution of collections of case studies to academic development in higher education , 2002 .

[6]  Ian A. Harwood,et al.  Implementing perception across a large HEI: getting it right , 2004 .

[7]  Myles Danson,et al.  Large Scale Implementation of Question Mark Perception (V2.5). Experiences at Loughborough University , 2001 .

[8]  Niall Sclater,et al.  Focus Group. Building a Compliance Audit for BS7988 "Code of Practice for the Use of Information Technology (IT) for the Delivery of Assessments , 2002 .

[9]  Joanna Bull,et al.  Computer Assisted Assessment Centre Update , 2001 .

[10]  Stan Zakrzewski,et al.  A Model for Computer-based Assessment: The catherine wheel principle , 2000 .

[11]  David O'Hare,et al.  Finding appropriate methods to assure quality Computer-Based Assessment development in UK Higher Education , 2003 .

[12]  Gráinne Conole,et al.  A review of computer-assisted assessment , 2005 .

[13]  G. Conole,et al.  A review of computer-assisted assessment , 2005 .

[14]  John G. Hedberg,et al.  Evaluating technology-based learning: Which model? , 1994, Interactive Multimedia in University Education.

[15]  C. Steven,et al.  Computer-based assessment: quality assurance issues, the hub of the wheel , 2003 .

[16]  L. van Rentergem,et al.  A campus wide setup of Question Mark Perception (V2.5) at the Katholieke Universiteit Leuven (Belgium) – facing a large scale implementation , 2002 .

[17]  John Kleeman,et al.  A practical look at delivering assessments to BS 7988 recommendations , 2002 .