The effect of audio and animation in multimedia instruction

This study investigated the effects of audio, animation, and spatial ability in a multimedia computer program for high school biology. Participants completed a multimedia program that presented content by way of text or audio with lean text. In addition, several instructional sequences were presented either with static illustrations or animations. The study examined the effects of instructional mode (text vs. audio), illustration mode (static illustration vs. animation), and spatial ability (low vs. high) on practice and posttest achievement, attitude and time. Results indicated that spatial ability was significantly related to practice achievement and attitude. Participants with high spatial ability performed better on the practice items than those with low spatial ability. Participants with low spatial ability responded more positively than those with high spatial ability to attitude items concerning concentration, interest, and amount of invested mental effort. Findings also revealed that participants who received animation spent significantly more time on the program than those who received static illustrations. Implications for the design of multimedia are discussed. ********** Computer-based instruction (CBI) containing multimedia is increasingly being used as an adjunct to traditional classroom instruction. Advances in CBI and web-based technology make it possible for a designer to include features such as full color, illustrations, audio, animation, and video. However, little research exists to support the notion that adding multimedia features to instruction improves learning and performance. The current study investigated the impact of using two multimedia features--audio and animation--on learning from CBI. Audio has usually been added to CBI as an afterthought to gain attention and increase motivation with sound effects, musical interludes, and congratulatory phrases. When audio has been added as voiced material, it has often occurred as redundant reading of screen text. Little research has been conducted to provide the instructional designer with guidelines for incorporating audio into CBI to promote learning. When guidelines do exist, they are frequently general and not always based on research (Barron, 1995). Indeed, little research exists to support the notion that adding audio to CBI can improve learning. Most early research on audio focused on the use of redundant audio (i.e., a voice reading word for word the text that is printed on a page or displayed visually). Hartman (1961) summarized and evaluated early audiovisual studies that looked at audio-print and print only presentation for instruction. He concluded that redundant audio-print instruction was more effective than either audio or print alone. In Hartman's review, most of the studies with positive effects for redundant audio involved grade school children. Hartman himself suggested that the limited reading skills of the children in the studies might have produced the audio-print superiority results. Research findings since Hartman's review are contradictory with some studies indicating that text plus audio is more effective than either alone (Enerson & Tumey, 1984; Hartman, 1961; Lauret, 1998; Menne & Menne, 1972; Nasser & McEwen, 1976). Other studies have found no advantage for audio-print over print alone (Barron & Atkins, 1994; Barron & Kysilka, 1993; Barron & Dwyer, 1987; Furnham, Gunter, & Green, 1990; Koroghlanian & Sullivan, 2000; Nugent, 1982; Rehaag & Szabo, 1995; Shih & Alessi, 1996; Van Mondfrans & Travers, 1964). These contradictory results can be explained by Paivio's dual coding theory, which proposed that two separate systems are involved in cognition, one for verbal information and another for image formation (Paivio, 1986). …

[1]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[2]  Frank R. Hartman,et al.  Single and multiple channel communication: A review of research and a proposed model , 1961 .

[3]  Robert M. W. Travers,et al.  Learning of Redundant Material Presented through Two Sensory Modalities , 1964, Perceptual and motor skills.

[4]  Joy Maxine Menne,et al.  The relative efficiency of bimodal presentation as an aid to learning , 1972 .

[5]  H. Simon,et al.  Perception in chess , 1973 .

[6]  William J. McEwen,et al.  The impact of alternative media channels: Recall and involvement with messages , 1976 .

[7]  Tyler Blake,et al.  Motion in Instructional Media: Some Subject-Display Mode Interactions , 1977 .

[8]  R. Wallace.  Biology, the World of Life , 1978 .

[9]  William Winn,et al.  The role of diagrammatic representation in learning sequences, identification and classification as a function of verbal and spatial ability , 1982 .

[10]  Gwen Nugent,et al.  Pictures, audio, and print: symbolic representation and effect on learning , 1982 .

[11]  H. J. Peters,et al.  Graphics and Animation as Instructional Tools: A Case Study. , 1982 .

[12]  Meryl Enerson,et al.  An Experiment with Speech on an Electronic Text Service. , 1984 .

[13]  G. Salomon.  Television is "easy" and print is "tough": The differential investment of mental effort in learning as a function of perceptions and attributions. , 1984 .

[14]  Benjamin H. Layne,et al.  Color, graphics, and animation in a computer-assisted learning tutorial lesson , 1988 .

[15]  Lloyd P. Rieber,et al.  Effects of textual and animated orienting activities and practice on learning from computer-based instruction , 1988 .

[16]  M. Just,et al.  Understanding Machines from Text and Diagrams. , 1989 .

[17]  Lloyd P. Rieber,et al.  The Effects of Computer Animated Elaboration Strategies and Practice on Factual and Application Learning in an Elementary Science Lesson , 1989 .

[18]  R. Mayer.  Systematic Thinking Fostered by Illustrations in Scientific Text , 1989 .

[19]  Joan K. Gallini,et al.  When Is an Illustration Worth Ten Thousand Words , 1990 .

[20]  Lloyd P. Rieber,et al.  Animation in computer-based instruction , 1990 .

[21]  A. Furnham,et al.  Remembering science: The recall of factual information as a function of the presentation mode , 1990 .

[22]  Lloyd P. Rieber,et al.  The effects of computer animation on adult learning and retrieval tasks , 1990 .

[23]  Ann E. Barron,et al.  The effectiveness of digital audio in computer-based training , 1991 .

[24]  John Sweller,et al.  The effects of technical illustrations on cognitive load , 1991 .

[25]  R. Mayer,et al.  Animations need narrations : an experimental test of a dual-coding hypothesis , 1991 .

[26]  Lloyd P. Rieber,et al.  Animation, incidental learning, and continuing motivation , 1991 .

[27]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[28]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[29]  R. Mayer,et al.  The instructive animation: helping students build connections between words and pictures in multimedia learning , 1992 .

[30]  P. Chandler,et al.  THE SPLIT‐ATTENTION EFFECT AS A FACTOR IN THE DESIGN OF INSTRUCTION , 1992 .

[31]  Susan Palmiter,et al.  Animated Demonstrations for Learning Procedural Computer-Based Tasks , 1993, Hum. Comput. Interact..

[32]  Richar E. Mayer.  Chapter 8 Visual Aids to Knowledge Construction: Building Mental Representations from Pictures and Words , 1994 .

[33]  R. Mayer,et al.  For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. , 1994 .

[34]  S. Brooks,et al.  Applied Multivariate Statistics for the Social Sciences , 1993 .

[35]  Ann E. Barron,et al.  Audio instruction in multimedia education: is textual redundancy important? , 1994 .

[36]  Ann E. Barron,et al.  Digital Audio in Multimedia , 1995 .

[37]  R. Mayer,et al.  A generative theory of textbook design: Using annotated illustrations to foster meaningful learning of science text , 1995 .

[38]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[39]  Yu-Fen Shih,et al.  Effects of text versus voice on learning in multimedia courseware , 1996 .

[40]  Francis M. Dwyer,et al.  The Effect of Computer-Generated Animation on Student Achievement of Different Types of Educational Objectives , 1996 .

[41]  Timothy A. Hays,et al.  Spatial Abilities and the Effects of Computer Animation on Short-Term and Long-Term Comprehension , 1996 .

[42]  David M. Lane,et al.  The use of animation in software training: Pitfalls and benefits. , 1997 .

[43]  Mary Hegarty,et al.  Individual differences in use of diagrams as external memory in mechanical reasoning , 1997 .

[44]  Hung-liang Lee,et al.  The use of animation as a tool for concept learning , 1997 .

[45]  Sharon K Tindall-Ford,et al.  When two sensory modes are better than one , 1997 .

[46]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[47]  Paul Chandler,et al.  Levels of Expertise and Instructional Design , 1998, Hum. Factors.

[48]  Hye-Won Kim.  Effects of animated graphics of plate tectonics on students' performance and attitudes in multimedia computer instruction , 1998 .

[49]  Francis M. Dwyer,et al.  Effect of Time and Level of Visual Enhancement in Facilitating Student Achievement of Different Educational Objectives. , 1998 .

[50]  Shu-Ling Lai.  The Effects of Visual Display on Analogies Using Computer-Based Learning , 1998 .

[51]  Ok-choon Park,et al.  Visual displays and contextual presentations in computer-based instruction , 1998 .

[52]  Richard K. Lowe.  Extracting information from an animation during complex visual learning , 1999 .

[53]  P. Wright,et al.  Static and animated graphics in learning from interactive texts , 1999 .

[54]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[55]  Wolfgang Schnotz,et al.  Individual and co-operative learning with interactive animated pictures , 1999 .

[56]  Howard J. Sullivan,et al.  Audio and Text Density in Computer-Based Instruction , 2000 .

[57]  Erica Wadley.  The Biology Project , 2001 .