Evaluation of alternate multimedia for web-based asynchronous learning

Choosing the appropriate multimedia for the learning modules or systems is critical to designing an efficient web-based asynchronous learning systems or modules. In response to this need, a study was conducted to gauge the effectiveness of different multimedia combinations, namely: text; audio and synchronized text; audio, video and synchronized text, for procedural-based tasks to support web-based learning for a senior-level Production, Planning and Control Course. Data were collected on performance, process and subjective measures. Analyses of these learning systems throw new light on the effectiveness of the different multimedia combinations to improve web-based learning of procedural tasks. The most salient finding of the study is that user performance is dependent on the type of multimedia combination and the type of learning task in terms of complexity. Interestingly, for low difficulty procedural tasks, the choice of multimedia is not critical for either performance or process efficiency. However, when the procedural tasks are complex, a combination of audio, video and synchronized text yields the best results both in terms of learning performance and process efficiency measured in terms of amount of time spent viewing the modules and the module accessing frequency. Another important finding is that an easy-to-use system does not imply an efficient learning system. The study helps recommend design guidelines for the most appropriate type of multimedia to be used in designing web-based asynchronous learning systems for different levels of procedural tasks.

[1]  M. Denny,et al.  Emotionality of pictures and the retention of related and unrelated phrases , 1978 .

[2]  D. J. Burns,et al.  The consequences of generation , 1992 .

[3]  Gwen Nugent,et al.  Pictures, audio, and print: symbolic representation and effect on learning , 1982 .

[4]  J. D. Fletcher,et al.  Effectiveness and Cost of Interactive Videodisc Instruction in Defense Training and Education. IDA Report R2372. , 1990 .

[5]  Lawrence J. Najjar Principles of Educational Multimedia User Interface Design , 1998, Hum. Factors.

[6]  Michael J. Watkins,et al.  When is recall spectacularly higher than recognition , 1974 .

[7]  Richard C. Anderson,et al.  On asking people questions about what they are reading , 1975 .

[8]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[9]  A. Paivio Dual coding theory: Retrospect and current status. , 1991 .

[10]  Ravinder Nath,et al.  Asynchronous learning environments: An empirical study , 1997 .

[11]  Chen-Lin C. Kulik,et al.  The Effectiveness of Computer-Based Adult Education: A Meta-Analysis , 1986 .

[12]  Jay H. Moskowitz,et al.  Computers in the Schools: Implications of Change , 1985 .

[13]  Barry S. Stein,et al.  Depth of processing reexamined: The effects of the precision of encoding and test appropriateness , 1978 .

[14]  Tyler Blake,et al.  Motion in Instructional Media: Some Subject-Display Mode Interactions , 1977 .

[15]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[16]  Lawrence J. Najjar A Review of the Fundamental Effects of Multimedia Information Presentation on Learning , 1995 .

[17]  J. Kulik,et al.  Effects of Computer-Based Teaching on Secondary School Students. , 1983 .

[18]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-based College Teaching: A Meta-analysis of Findings , 1980 .

[19]  M. McDaniel,et al.  Generation and precision of elaboration: Effects on intentional and incidental learning. , 1987 .

[20]  Werner Severin,et al.  The effectiveness of relevant pictures in multiple-channel communications , 1967 .

[21]  D. Stone,et al.  How Do Young Adults Read Directions with and without Pictures , 1981 .

[22]  Leslie J. Briggs,et al.  Principles of Instructional Design , 1974 .

[23]  J. Bransford,et al.  Constraints on effective elaboration: Effects of precision and subject generation , 1979 .

[24]  Robert A. Bjork,et al.  The Generation Effect: Support for a Two-Factor Theory , 1988 .

[25]  James R. Lewis Introduction: Current Issues in Usability Evaluation , 2001, Int. J. Hum. Comput. Interact..

[26]  George R. Bieger,et al.  Comprehending Spatial and Contextual Information in Picture-Text Instructions , 1986 .

[27]  Herbert J. Walberg,et al.  Computer-Assisted Instruction With Exceptional Children , 1985 .

[28]  Lloyd P. Rieber,et al.  Using Computer Animated Graphics in Science Instruction with Children , 1990 .

[29]  Khalili Ahmad,et al.  The Effectiveness of Computer Applications , 1994 .

[30]  J. D. Fletcher The effectiveness and cost of interactive videodisc instruction , 1989 .

[31]  R. Mayer,et al.  The instructive animation: helping students build connections between words and pictures in multimedia learning , 1992 .

[32]  Joan K. Gallini,et al.  When Is an Illustration Worth Ten Thousand Words , 1990 .

[33]  David E. Kieras,et al.  The Role of a Mental Model in Learning to Operate a Device. , 1984 .

[34]  H. Mar,et al.  Encoding processes and the recall of text , 1983, Memory & cognition.

[35]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-Based Education in Secondary Schools. , 1985 .

[36]  Donald A. Norman,et al.  Explorations in Cognition , 1975 .

[37]  John R. Bourne,et al.  Paradigms for on-line learning: a case study in the design and implementation of an asynchronous learning networks (ALN) course , 1997, Proceedings Frontiers in Education 1997 27th Annual Conference. Teaching and Learning in an Era of Change.

[38]  A. Ehrenfeucht,et al.  Encoding and retaining information in the visuals and verbals of an educational movie , 1983 .

[39]  Mark Chignell,et al.  Intelligent Interfaces: Theory, Research and Design , 1989 .

[40]  James Bosco,et al.  An analysis of evaluations of interactive video , 1986 .

[41]  W. Howard Levie,et al.  Effects of text illustrations: A review of research , 1982 .

[42]  A. Paivio,et al.  Picture superiority in free recall: Imagery or dual coding? , 1973 .

[43]  Benjamin H. Layne,et al.  Color, graphics, and animation in a computer-assisted learning tutorial lesson , 1988 .

[44]  Lawrence J. Najjar The Effects of Multimedia and Elaborative Encoding on Learning , 1996 .

[45]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[46]  John R. Anderson The Architecture of Cognition , 1983 .

[47]  Lawrence J. Najjar Multimedia information and learning , 1996 .

[48]  John R. Anderson Cognitive Psychology and Its Implications , 1980 .

[49]  F. Craik,et al.  Levels of Processing in Human Memory , 1979 .

[50]  R. Mayer,et al.  Animations need narrations : an experimental test of a dual-coding hypothesis , 1991 .

[51]  Sallie E. Gordon,et al.  Systematic training program design : maximizing effectiveness and minimizing liability , 1994 .

[52]  Tim Berners-Lee,et al.  Universal Resource Identifiers in WWW: A Unifying Syntax for the Expression of Names and Addresses of Objects on the Network as used in the World-Wide Web , 1994, RFC.

[53]  Ok-Choon Park,et al.  Instructional conditions for using dynamic visual displays: a review , 1992 .

[54]  William B. Whitten,et al.  Information stored when expecting recall or recognition. , 1983 .

[55]  Lawrence J. Najjar Dual Coding as a Possible Explanation for the Effects of Multimedia on Learning , 1995 .

[56]  Andy Sloane Learning with the web: Experience of using the World Wide Web in a learning environment , 1997, Comput. Educ..

[57]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[58]  L. Jacoby On interpreting the effects of repetition: Solving a problem versus remembering a solution , 1978 .

[59]  Richard B. Lewis,et al.  AV instruction--technology, media, and methods , 1973 .

[60]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[61]  Malcolm L. Fleming,et al.  Instructional Message Design: Principles from the Behavioral and Cognitive Sciences , 1993 .

[62]  N. J. Slamecka,et al.  The Generation Effect: Delineation of a Phenomenon , 1978 .