Interactive Multimodal Learning Environments

What are interactive multimodal learning environments and how should they be designed to promote students’ learning? In this paper, we offer a cognitive–affective theory of learning with media from which instructional design principles are derived. Then, we review a set of experimental studies in which we found empirical support for five design principles: guided activity, reflection, feedback, control, and pretraining. Finally, we offer directions for future instructional technology research.

[1]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[2]  E. Tulving,et al.  Organization of memory. , 1973 .

[3]  A. Paivio.  Mental Representations: A Dual Coding Approach , 1986 .

[4]  M. Lynne Markus,et al.  Toward a “Critical Mass” Theory of Interactive Media , 1987 .

[5]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[6]  C. Penney.  Modality effects and the structure of short-term verbal memory , 1989, Memory & cognition.

[7]  L. Schauble,et al.  Belief revision in children: the role of prior knowledge and strategies for generating evidence. , 1990, Journal of experimental child psychology.

[8]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[9]  R. Hogarth,et al.  Learning from feedback: exactingness and incentives. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Otto Jelsma,et al.  Training for reflective expertise: A four-component instructional design model for complex cognitive skills , 1992 .

[11]  Timothy L. Seifert,et al.  Effects of elaborative interrogation with prose passages. , 1993 .

[12]  M. Chi,et al.  Eliciting Self‐Explanations Improves Understanding , 1994 .

[13]  Michael Pressley,et al.  Use of elaborative interrogation to help students acquire information consistent with prior knowledge and information inconsistent with prior knowledge , 1994 .

[14]  Ellen D. Wagner,et al.  In Support of a Functional Definition of Interaction , 1994 .

[15]  Gary Marchionini,et al.  Information Seeking in Electronic Environments , 1995 .

[16]  Michael J. Jacobson,et al.  Learning with hypertext learning environments: theory, design, and research , 1995 .

[17]  Wim H. Gijselaers,et al.  Bringing Problem-Based Learning To Higher Education: Theory And Practice , 1996 .

[18]  Willis D. Copeland,et al.  Video cases and the development of meaning making in preservice teachers , 1996 .

[19]  Munindar P. Singh,et al.  Conversational Agents , 1997 .

[20]  John Sweller,et al.  Cognitive load theory and instructional design , 1997 .

[21]  G. Lakoff.  The Metaphorical Structure of Mathematics: Sketching Out Cognitive Foundations For a Mind-Based Mathematics , 1997 .

[22]  Lyn D. English,et al.  Mathematical reasoning : analogies, metaphors, and images , 1997 .

[23]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[24]  R. Bruning.  Cognitive Psychology and Instruction , 1998 .

[25]  Jens F. Jensen,et al.  Interactivity: Tracking a New Concept in Media and Communication Studies , 1998 .

[26]  Barbara B. Levin,et al.  Who learns what from cases and how? : the research base for teaching and learning with cases , 1999 .

[27]  R. Mayer,et al.  Maximizing Constructivist Learning From Multimedia Communications by Minimizing Cognitive Load , 1999 .

[28]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[29]  J. Tuovinen,et al.  A comparison of cognitive load associated with discovery learning and worked examples , 1999 .

[30]  Susan M. Land,et al.  Theoretical Foundations of Learning Environments. , 1999 .

[31]  R. Mayer,et al.  Multimedia-Supported Metaphors for Meaning Making in Mathematics , 1999 .

[32]  John Sweller,et al.  Instructional Design in Technical Areas , 1999 .

[33]  R. Mayer,et al.  Engaging students in active learning: The case for personalized multimedia messages. , 2000 .

[34]  Rich Gazan,et al.  Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth Prototype (ADEPT) , 2000, Libr. Trends.

[35]  H. Spotts,et al.  Developments in marketing science , 2000 .

[36]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[37]  L. Corno,et al.  Teacher Innovations in Self-Regulated Learning , 2000 .

[38]  Susanne P. Lajoie,et al.  Computers as Cognitive Tools: No More Walls , 2000 .

[39]  P. Pintrich,et al.  Handbook of self-regulation , 2000 .

[40]  J. Bransford.  How people learn , 2000 .

[41]  R. Mayer,et al.  A coherence effect in multimedia learning: The case for minimizing irrelevant sounds in the design of multimedia instructional messages. , 2000 .

[42]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[43]  James C. Lester,et al.  The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedagogical Agents? , 2001 .

[44]  R. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[45]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[46]  R. Mayer,et al.  When learning is just a click away: Does simple user interaction foster deeper understanding of multimedia messages? , 2001 .

[47]  R. Mayer,et al.  Learning Science in Virtual Reality Multimedia Environments: Role of Methods and Media , 2002 .

[48]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[49]  Robert J. Beck,et al.  Effects of Videocase Construction on Preservice Teachers' Observations of Teaching , 2002 .

[50]  R. Mayer,et al.  Verbal redundancy in multimedia learning: When reading helps listening , 2002 .

[51]  Richard E Mayer,et al.  Fostering understanding of multimedia messages through pre-training: evidence for a two-stage theory of mental model construction. , 2002, Journal of experimental psychology. Applied.

[52]  Patricia D. Mautone,et al.  Pictorial aids for learning by doing in a multimedia geology simulation game. , 2002 .

[53]  H. Tabbers,et al.  The modality of text in multimedia instructions:Refining the design guidelines. , 2002 .

[54]  P. Chandler,et al.  Assimilating complex information , 2002 .

[55]  Sally J. McMillan.  Exploring Models of Interactivity from Multiple Research Traditions: Users, Documents, and Systems , 2002 .

[56]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[57]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[58]  Richard E. Mayer,et al.  Multimedia learning in an interactive self-explaining environment: What works in the design of agent , 2003 .

[59]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[60]  Sadhana Puntambekar,et al.  Improving Navigation and Learning in Hypertext Environments With Navigable Concept Maps , 2003, Hum. Comput. Interact..

[61]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[62]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[63]  P. Pintrich.  Motivation and Classroom Learning , 2003 .

[64]  Marcia C. Linn,et al.  Internet Environments for Science Education , 2004 .

[65]  S. Schwan,et al.  The cognitive benefits of interactive videos: learning to tie nautical knots , 2004 .

[66]  R. Mayer.  Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction. , 2004, The American psychologist.

[67]  James C. Lester,et al.  Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments , 2004, User Modeling and User-Adapted Interaction.

[68]  R. Moreno.  Decreasing Cognitive Load for Novice Students: Effects of Explanatory versus Corrective Feedback in Discovery-Based Multimedia , 2004 .

[69]  R. Mayer,et al.  Personalized messages that promote science learning in virtual environments , 2004 .

[70]  R. Moreno,et al.  Do Multiple Representations Need Explanations? The Role of Verbal Guidance and Individual Differences in Multimedia Mathematics Learning , 2004 .

[71]  Lloyd P. Rieber,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning in Games, Simulations, and Microworlds , 2005 .

[72]  John Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Split-Attention Principle in Multimedia Learning , 2005 .

[73]  Andrew Dillon,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning with Hypermedia , 2005 .

[74]  R. Moreno,et al.  Cognitive load and learning effects of having students organize pictures and words in multimedia environments: The role of student interactivity and feedback , 2005 .

[75]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[76]  J. Sweller,et al.  The Cambridge Handbook of Multimedia Learning: The Modality Principle in Multimedia Learning , 2005 .

[77]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Introduction to Multimedia Learning , 2005 .

[78]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[79]  Richard E. Mayer,et al.  Principles for managing essential processing in multimedia learning: Segmenting, pre-training, and modality principles. , 2005 .

[80]  Roxana Moreno,et al.  The Cambridge Handbook of Multimedia Learning: Multimedia Learning with Animated Pedagogical Agents , 2005 .

[81]  J. D. Fletcher,et al.  The Multimedia Principle. , 2005 .

[82]  R. Azevedo.  Computer Environments as Metacognitive Tools for Enhancing Learning , 2005 .

[83]  Adrianus W. Lazonder,et al.  The guided discovery principle in multimedia learning. , 2005 .

[84]  Jean-François Rouet,et al.  The Cambridge Handbook of Multimedia Learning: Navigational Principles in Multimedia Learning , 2005 .

[85]  R. Mayer,et al.  Role of guidance, reflection, and interactivity in an agent-based multimedia game , 2005 .

[86]  Ibrahim Khatete.  Innovations in Science and Mathematics Education , 2005 .

[87]  R. Moreno.  Learning in High-Tech and Multimedia Environments , 2006 .

[88]  R. Moreno,et al.  Does the modality principle hold for different media? A test of the method-affects-learning hypothesis , 2006, J. Comput. Assist. Learn..

[89]  R. Moreno,et al.  Students' choice of animated pedagogical agents in science learning: A test of the similarity-attraction hypothesis on gender and ethnicity , 2006 .

[90]  F. Paas,et al.  Interactivity in Video-based Models , 2007 .

[91]  R. Moreno.  Optimising learning from animations by minimising cognitive load: cognitive and affective consequences of signalling and segmentation methods , 2007 .

[92]  Ludmila C. Ortegano-Layne,et al.  Do classroom exemplars promote the application of principles in teacher education? A comparison of videos, animations, and narratives , 2008 .