Evaluating interactive multimedia courseware—a methodology

Abstract Learning design is an important aspect of multimedia courseware production since it significantly influences the quality of the courseware that is produced. In order to help formulate a model for learning design a wide range of courseware products have been examined using a standard method of assessment. The purpose of the evaluations was to try to identify any ‘hallmarks of quality’ that seemed to characterize good learning products. This paper describes the steps involved in deriving the evaluation methodology and its use within the context of assessing the quality of learning design embedded within a range of multimedia courseware products that have been published on interactive compact disc.

[1]  Thomas C. Reeves,et al.  Research and evaluation models for the study of interactive video , 1986 .

[2]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-based College Teaching: A Meta-analysis of Findings , 1980 .

[3]  Michael Prosser.  Towards More Effective Evaluation Studies of Educational Media. , 1984 .

[4]  Denis Hlynka,et al.  Formative Evaluation of Prototypical Products: From Expert to Connoisseur. , 1993 .

[5]  N D C Harris,et al.  Conceptual Problems Associated with the Evaluation of Educational Technology Courses. , 1982 .

[6]  James Bosco,et al.  An analysis of evaluations of interactive video , 1986 .

[7]  Y. Sankar,et al.  Evaluation of Computer‐Assisted Instruction , 1988 .

[8]  Andrew J. Barrett,et al.  Must computer courseware evaluation be totally subjective? , 1989, Br. J. Educ. Technol..

[9]  Helen Mills,et al.  Criteria for evaluating interactive instructional materials for adult self-directed learners , 1989 .

[10]  Kanji Akahori.  Evaluation of Educational Computer Software in Japan (I): Methods and Results , 1988 .

[11]  Ron Owston,et al.  The State of Educational Software: A Criterion-Based Evaluation. , 1987 .

[12]  Philip Barker,et al.  Design Guidelines for Electronic Book Production , 1992 .

[13]  Jakob Nielsen,et al.  The usability engineering life cycle , 1992, Computer.

[14]  Tony Bates.  Towards a Better Research Framework for Evaluating the Effectiveness of Educational Media , 1981 .

[15]  Sivasailam Thiagarajan,et al.  Instructional product verification and revision: 20 questions and 200 speculations , 1978 .

[16]  Harold Pearse,et al.  The Educational Imagination , 1979 .

[17]  Michael R. Kibby,et al.  An approach to the evaluation of hypermedia , 1991 .

[18]  L. Plowman.  Learning from learning theories: an overview for designers of interactive video , 1989 .

[19]  Peter Copeland.  The Multimedia Mix , 1991 .

[20]  Gary G. Bitter,et al.  The Most Important Criteria Used by the Educational Software Evaluation Consortium. , 1987 .

[21]  James O. Carey,et al.  The systematic design of instruction , 1978 .

[22]  C W Clegg,et al.  Towards a practical method of user interface evaluation. , 1989, Applied ergonomics.

[23]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.