Extending multimedia research: How do prerequisite knowledge and reading comprehension affect learning from text and pictures

The present study aimed at extending research on multimedia design principles by investigating their validity as a function of learners' reading comprehension and scientific literacy. Students (N=125; age: M=15.11years) learned about cell reproduction during their regular Biology lessons in one of six conditions resulting from cross-varying multimedia (text only vs. text plus animations) and text modality (spoken vs. written vs. spoken and written). Recall and transfer were assessed immediately after learning and again 1week later. Overall, adding animations to text as well as using spoken rather than written text improved only immediate recall; in addition, a multimedia effect for delayed recall was observed for learners with higher levels of scientific literacy. A redundant presentation of text proved harmful especially for delayed performance measures. Reading comprehension did not moderate multimedia design effects. Students with more suitable cognitive prerequisites were better able to maintain performance from the immediate to the delayed tests. Future multimedia research should further investigate the boundary conditions that moderate multimedia effectiveness.

[1]  K. Scheiter,et al.  Explaining the modality effect in multimedia learning: Is it due to a lack of temporal contiguity with written text and pictures? , 2012 .

[2]  H. Tabbers,et al.  Multimedia instructions and cognitive load theory: effects of modality and cueing. , 2004, The British journal of educational psychology.

[3]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[4]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[5]  P. Spargo,et al.  Development of a pool of scientific literacy test‐items based on selected AAAS literacy goals , 1996 .

[6]  J. Sinacore.  Multiple regression: Testing and interpreting interactions , 1993 .

[7]  Welcome to our new Australasian editor , 2001 .

[8]  Barbara Tversky,et al.  Animation: Does It Facilitate Learning? , 2000 .

[9]  R. Mayer,et al.  For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. , 1994 .

[10]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[11]  M. Gernsbacher,et al.  Investigating differences in general comprehension skill. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[12]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[13]  Klaus D. Stiller,et al.  How pacing of multimedia instructions can influence modality effects: A case of superiority of visual texts , 2009 .

[14]  Yvonne Kammerer,et al.  The effects of realism in learning with dynamic visualizations , 2009 .

[15]  R. Curtis,et al.  Designing health communication: Testing the explanations for the impact of communication medium on effectiveness , 2000 .

[16]  Kirsten R. Butcher.  Learning from Text with Diagrams: Promoting Mental Model Development and Inference Generation. , 2006 .

[17]  M. McDaniel,et al.  Pictorial enhancement of text memory: Limitations imposed by picture type and comprehension skill , 1992, Memory & cognition.

[18]  Nicola Yuill,et al.  Effect of organizational cues and strategies on good and poor comprehenders' story understanding. , 1988 .

[19]  Eliane Segers,et al.  The modality effect tested in children in a user-paced multimedia environment , 2010, J. Comput. Assist. Learn..

[20]  Eliane Segers,et al.  Cognitive processes in children's multimedia text learning , 2008 .

[21]  Rolf A. Zwaan,et al.  Indexing space and time in film understanding , 2001 .

[22]  S. West,et al.  Multiple Regression: Testing and Interpreting Interactions. , 1994 .

[23]  Michael Beveridge,et al.  EFFECTS OF TEXT ILLUSTRATION ON CHILDREN'S LEARNING OF A SCHOOL SCIENCE TOPIC , 1986 .

[24]  Cheryl I. Johnson,et al.  Revising the Redundancy Principle in Multimedia Learning. , 2008 .

[25]  B. Holmes,et al.  Children's Inferences with Print and Pictures. , 1987 .

[26]  Robert M. Gagné,et al.  The Conditions of Learning and Theory of Instruction , 1985 .

[27]  Barrie Gunter,et al.  Children's and adults' recall of children's news stories in both print and audio-visual presentation modalities , 2002 .

[28]  C. Bazerman.  Physicists Reading Physics , 1985 .

[29]  Paul Ginns.  Meta-Analysis of the Modality Effect. , 2005 .

[30]  Martin Reisslein,et al.  Teaching with Concrete and Abstract Visual Representations: Effects on Students' Problem Solving, Problem Representations, and Learning Perceptions. , 2011 .

[31]  V. Gyselinck,et al.  The role of working memory components in multimedia comprehension , 2008 .

[32]  Richard Lowe,et al.  Animation and learning: selective processing of information in dynamic graphics , 2003 .

[33]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[34]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[35]  J. Sweller,et al.  Cognitive load theory, the transient information effect and e-learning , 2012 .

[36]  Katharina Scheiter,et al.  The influence of text modality on learning with static and dynamic visualizations , 2011, Comput. Hum. Behav..

[37]  Katharina Scheiter,et al.  Boundary Conditions and Constraints of the Modality Effect , 2011 .

[38]  Katharina Scheiter,et al.  The perceptual basis of the modality effect in multimedia learning. , 2011, Journal of experimental psychology. Applied.

[39]  P. van den Broek,et al.  Using Texts in Science Education: Cognitive Processes and Knowledge Representation , 2010, Science.

[40]  R. Mayer,et al.  Verbal redundancy in multimedia learning: When reading helps listening , 2002 .

[41]  D. Leutner,et al.  Instructional animation versus static pictures: A meta-analysis , 2007 .

[42]  J. Sweller,et al.  Cognitive load theory, modality of presentation and the transient information effect. , 2011 .

[43]  Jukka Hyönä,et al.  Do adult readers know how they read? Evidence from eye movement patterns and verbal reports. , 2006, British journal of psychology.

[44]  Wolfgang Schnotz,et al.  Colorful Bouquets in Multimedia ­Research: A Closer Look at the Modality Effect , 2011 .

[45]  Katharina Scheiter,et al.  Learning about locomotion patterns from visualizations: Effects of presentation format and realism , 2011, Comput. Educ..

[46]  R. Mayer,et al.  Cognitive constraints on multimedia learning: When presenting more material results in less understanding. , 2001 .

[47]  Janet E. Davidson,et al.  Information processing correlates of reading , 1985, Journal of Memory and Language.

[48]  Erol Özçelik,et al.  Why does signaling enhance multimedia learning? Evidence from eye movements , 2010, Comput. Hum. Behav..

[49]  Joseph P. Magliano,et al.  Chapter 9 Toward a Comprehensive Model of Comprehension , 2009 .