Cognitive Effects of Multimedia Learning

Now established as an effective tool in the instructional process, multimedia has penetrated educational systems at almost every level of study. In their quest to maximize educational outcomes and identify best practices, multimedia researchers are now expanding their examinations to extend towards the cognitive functionality of multimedia.Cognitive Effects of Multimedia Learning identifies the role and function of multimedia in learning through a collection of research studies focusing on cognitive functionality. An advanced collection of critical theories and practices, this much needed contribution to the research is an essential holding for academic libraries, and will benefit researchers, practitioners and students in basic and applied fields ranging from education to cognitive sciences.

[1]  Gary J. Anglin,et al.  On Empirically Validating Functions of Pictures in Prose , 1987 .

[2]  J Eliot,et al.  Classification of Figural Spatial Tests , 1980, Perceptual and motor skills.

[3]  David C. Rubin,et al.  The Basic-Systems Model of Episodic Memory , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[4]  S. Ainsworth.  DeFT: A Conceptual Framework for Considering Learning with Multiple Representations. , 2006 .

[5]  Alan M. MacEachren,et al.  How Maps Work - Representation, Visualization, and Design , 1995 .

[6]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[7]  J. Engelkamp.  Memory for actions , 1998 .

[8]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[9]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[10]  Richard Lowe,et al.  Animation and learning: selective processing of information in dynamic graphics , 2003 .

[11]  J. Carroll.  Human Cognitive Abilities-a sur-vey of factor-analytic studies , 1993 .

[12]  Helga Noice,et al.  What Studies of Actors and Acting Can Tell Us About Memory and Cognitive Functioning , 2006 .

[13]  Jana Holsanova.  Discourse, vision, and cognition , 2008 .

[14]  Asha K. Jitendra,et al.  A comparison of single and multiple strategy instruction on third-grade students' mathematical problem solving. , 2007 .

[15]  Randolph A. Philipp.  The Many Uses of Algebraic Variables. , 1992 .

[16]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[17]  N. S. Johnson,et al.  Some of the thousand words a picture is worth. , 1976 .

[18]  Steven Pinker,et al.  A theory of graph comprehension. , 1990 .

[19]  R. Barthes.  Rhétorique de l'image , 1964 .

[20]  Susan M. Wagner,et al.  Probing the Mental Representation of Gesture: Is Handwaving Spatial?. , 2004 .

[21]  I. Rock,et al.  The legacy of Gestalt psychology. , 1990, Scientific American.

[22]  Helen C. Purchase.  Informationally equivalent representations: An architecture and applications , 1999 .

[23]  Jon Oberlander,et al.  A cognitive theory of graphical and linguistic reasoning: logic and implementation. Cognitive Science , 1995 .

[24]  J. Sarama,et al.  Effects of a Preschool Mathematics Curriculum: Summative Research on the Building Blocks Project , 2007 .

[25]  Ricardo Nemirovsky,et al.  Body Motion and Graphing , 1998 .

[26]  Stephen K. Reed,et al.  Cognitive Architectures for Multimedia Learning , 2006 .

[27]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[28]  J. Piaget.  Recherches sur l'abstraction réfléchissante. I. L'abstraction des relations logico-arithmétiques , 1977 .

[29]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[30]  Stephen K. Reed,et al.  Memory for Problem Solutions , 1977 .

[31]  Richard K. Lowe.  Extracting information from an animation during complex visual learning , 1999 .

[32]  D. Schwartz,et al.  Inferences through imagined actions: Knowing by simulated doing. , 1999 .

[33]  E. Gombrich.  ART AND ILLUSION: A STUDY IN THE PSYCHOLOGY OF PICTORIAL REPRESENTATION. , 1960 .

[34]  Jennifer M. Shephard,et al.  Spatial versus object visualizers: A new characterization of visual cognitive style , 2005, Memory & cognition.

[35]  L Nyberg,et al.  Activity in motor areas while remembering action events , 2000, Neuroreport.

[36]  C. Dede,et al.  Scaling Up Success : Lessons Learned from Technology-Based Educational Improvement , 2005 .

[37]  P. Thompson.  Notations, Conventions, and Constraints: Contributions to Effective Uses of Concrete Materials in Elementary Mathematics. , 1992 .

[38]  Pierre Feyereisen,et al.  Further investigation on the mnemonic effect of gestures: Their meaning matters , 2006 .

[39]  Kevin Shockley,et al.  Dual-task influences on retrieval from semantic memory and coordination dynamics , 2006, Psychonomic bulletin & review.

[40]  Stephen K. Reed,et al.  Thinking Visually , 2010 .

[41]  Lara M. Triona,et al.  Point and Click or Grab and Heft: Comparing the Influence of Physical and Virtual Instructional Materials on Elementary School Students' Ability to Design Experiments , 2003 .

[42]  Alan M. MacEachren,et al.  Exploratory cartographic visualization: advancing the agenda , 1997 .

[43]  J. Sweller,et al.  Cognitive load effects in a primary-school geometry task , 1993 .

[44]  Christine D. Wilson,et al.  Grounding conceptual knowledge in modality-specific systems , 2003, Trends in Cognitive Sciences.

[45]  Daniel L. Schwartz,et al.  Reasoning about the referent of a picture versus reasoning about the picture as the referent: An effect of visual realism , 1995, Memory & cognition.

[46]  Lieven Verschaffel,et al.  The Effects of Different Problem Presentations and Formulations on the Illusion of Linearity in Secondary School Students , 2002 .

[47]  D. Fisher,et al.  Identifying and Remedying Failures of Selective Attention in Younger Drivers , 2006 .

[48]  Brockenbrough S. Allen,et al.  MEDIA AS LIVED ENVIRONMENTS: THE ECOLOGICAL PSYCHOLOGY OF EDUCATIONAL TECHNOLOGY , 1996 .

[49]  Theo van Leeuwen,et al.  Reading Images: The Grammar of Visual Design , 1996 .

[50]  J. Hyönä,et al.  Utilization of Illustrations during Learning of Science Textbook Passages among Low- and High-Ability Children. , 1999, Contemporary educational psychology.

[51]  Yuri Engelhardt,et al.  A Meta-Taxonomy for Diagram Research , 2002, Diagrammatic Representation and Reasoning.

[52]  Wolff‐Michael Roth,et al.  Prevalence, function, and structure of Photographs in high school biology textbooks , 2003 .

[53]  Wolfgang Schnotz,et al.  Commentary: Towards an Integrated View of Learning from Text and Visual Displays , 2002 .

[54]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[55]  Manfredo Massironi,et al.  The Psychology of Graphic Images: Seeing, Drawing, Communicating , 2001 .

[56]  Gavriel Salomon,et al.  Media and Symbol Systems as Related to Cognition and Learning. , 1979 .

[57]  C. Hmelo‐Silver,et al.  Scaffolding and Achievement in Problem-Based and Inquiry Learning: A Response to Kirschner, Sweller, and Clark (2006) , 2007 .

[58]  Evelyn Goldsmith.  Research into Illustration:An Approach and a Review , 1984 .

[59]  Lloyd P. Rieber,et al.  Animation in computer-based instruction , 1990 .

[60]  P. Shah,et al.  Review of Graph Comprehension Research: Implications for Instruction , 2002 .

[61]  Meianie C Steffens.  Memory for goal-directed sequences of actions: Is doing better than seeing? , 2007, Psychonomic bulletin & review.

[62]  M. Alibali,et al.  Children's Thinking , 1986 .

[63]  P. Moyer.  Are We Having Fun Yet? How Teachers Use Manipulatives to Teach Mathematics , 2001 .

[64]  Jay Doblin,et al.  A structure for nontextual communications , 1980 .

[65]  Jae Young Han,et al.  Critical Graphicacy: Understanding Visual Representation Practices in School Science , 2005 .

[66]  M. Hegarty,et al.  Individual differences in mental animation during mechanical reasoning , 1994, Memory & cognition.

[67]  D. Norman.  Perspectives on cognitive science , 1981 .

[68]  Kevin Mullet,et al.  Designing Visual Interfaces: Communication Oriented Techniques , 1994 .

[69]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[70]  Johnson,et al.  Text Learning Using Scientific Diagrams: Implications for Classroom Use , 1996, Contemporary educational psychology.

[71]  Wilkinson,et al.  Perceptual Components of Computer Displays , 1982, IEEE Computer Graphics and Applications.

[72]  Kathryn L. Alesandrini,et al.  Computer Graphics in Learning and Instruction , 1987 .

[73]  B. Homer,et al.  Optimizing cognitive load for learning from computer-based science simulations , 2006 .

[74]  Mark T. Maybury,et al.  Research in multimedia and multimodal parsing and generation , 1995, Artificial Intelligence Review.

[75]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[76]  R. Logie.  Visuo-spatial Working Memory , 1994 .

[77]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[78]  Ioanna Vekiri.  What Is the Value of Graphical Displays in Learning? , 2002 .

[79]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[80]  M. Hegarty,et al.  Individual Differences in Spatial Abilities , 2005 .

[81]  Niels Ole Bernsen,et al.  Foundations of Multimodal Representations: A Taxonomy of Representational Modalities , 1994, Interact. Comput..

[82]  Lloyd J. Rieber.  Computers Graphics and Learning , 1994 .

[83]  J. Cremer,et al.  Children's Road Crossing , 2007, Current directions in psychological science.

[84]  Kevin Mullet,et al.  Designing Visual Interfaces , 1996, SGCH.

[85]  A. Koriat,et al.  Memory organization of action events and its relationship to memory performance. , 2003, Journal of experimental psychology. General.

[86]  J. Schooler,et al.  The Misremembrance of Wines Past: Verbal and Perceptual Expertise Differentially Mediate Verbal Overshadowing of Taste Memory , 1996 .

[87]  Helen M. Doerr,et al.  An Analysis of Prospective Teachers' Dual Roles in Understanding the Mathematics of Change: Eliciting Growth With Technology , 2001 .

[88]  Axel Buchner,et al.  Quite ordinary retrieval cues may determine free recall of actions , 2003 .

[89]  Yvonne Rogers,et al.  External cognition: how do graphical representations work? , 1996, Int. J. Hum. Comput. Stud..

[90]  J. Henderson.  Visual Attention and Eye Movement Control During Reading and Picture Viewing , 1992 .

[91]  T. Gog,et al.  Uncovering Expertise-Related Differences in Troubleshooting Performance: Combining Eye Movement and Concurrent Verbal Protocol Data , 2005 .

[92]  Robert L. Goldstone,et al.  The Transfer of Scientific Principles Using Concrete and Idealized Simulations , 2005, Journal of the Learning Sciences.

[93]  Umberto Eco,et al.  A theory of semiotics , 1976, Advances in semiotics.

[94]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[95]  Neff Walker,et al.  A classification of visual representations , 1994, CACM.

[96]  Sandra P. Marshall,et al.  Schemas in Problem Solving , 1995 .

[97]  Lara M. Triona,et al.  Hands on What? The Relative Effectiveness of Physical versus Virtual Materials in an Engineering Design Project by Middle School Children , 2007 .

[98]  J. Hochberg,et al.  Pictorial recognition as an unlearned ability: a study of one child's performance. , 1962, The American journal of psychology.

[99]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[100]  J. Knowlton.  On the definition of “Picture” , 1966 .

[101]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[102]  George R. Bieger,et al.  The Information Content of Picture-Text Instructions , 1985 .

[103]  J. Deloache,et al.  The Origins of Pictorial Competence , 2003 .

[104]  E. Wiebe,et al.  The Interpretation of Cellular Transport Graphics by Students with Low and High Prior Knowledge , 2008 .

[105]  Jennifer L. Chiu,et al.  Teaching and Assessing Knowledge Integration in Science , 2006, Science.

[106]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[107]  G. Underwood.  Cognitive processes in eye guidance , 2005 .

[108]  John K. Gilbert,et al.  Visualization in science education , 2005 .

[109]  Stephen K. Reed,et al.  From Research to Practice and Back: The Animation Tutor Project , 2005 .

[110]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[111]  Mary Hegarty,et al.  Revising the Visualizer-Verbalizer Dimension: Evidence for Two Types of Visualizers , 2002 .

[112]  George W. McConkie,et al.  Eye movements and human information processing , 1985 .

[113]  Stephen K. Reed.  Does Unit Analysis Help Students Construct Equations? , 2006 .

[114]  B. White,et al.  Metamodeling Knowledge: Developing Students' Understanding of Scientific Modeling , 2005 .

[115]  J. Peeck.  The Role of Illustrations in Processing and Remembering Illustrated Text , 1987 .

[116]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[117]  R. Mayer,et al.  How Seductive Details Do Their Damage: A Theory of Cognitive Interest in Science Learning , 1998 .

[118]  Susan M. Wagner,et al.  How our hands help us learn , 2005, Trends in Cognitive Sciences.

[119]  Edward Tufte,et al.  Visual Explanations , 1997 .

[120]  Judy S. DeLoache,et al.  Early Understanding and Use of Symbols: The Model Model , 1995 .

[121]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[122]  W. Howard Levie,et al.  Effects of text illustrations: A review of research , 1982 .

[123]  Willem J. M. Levelt,et al.  The speaker’s linearization problem , 1981 .

[124]  N. Goodman,et al.  Languages of art : an approach to a theory of symbols , 1979 .

[125]  Johannes Engelkamp,et al.  Gains and Losses in Action Memory , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[126]  A. Paivio.  Dual coding theory: Retrospect and current status. , 1991 .

[127]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[128]  R. Gibbs.  Embodiment and Cognitive Science: Concepts , 2005 .

[129]  R. Mayer,et al.  Three Facets of Visual and Verbal Learners: Cognitive Ability, Cognitive Style, and Learning Preference. , 2003 .

[130]  Patricia Baggett,et al.  Role of temporal overlap of visual and auditory material in forming dual media associations. , 1984 .

[131]  Alan Richardson,et al.  Verbalizer-visualizer: A cognitive style dimension. , 1977 .

[132]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[133]  Jean Piaget,et al.  Studies in Reflecting Abstraction , 2001 .

[134]  Russell N. Carney,et al.  Pictorial Illustrations Still Improve Students' Learning from Text , 2002 .

[135]  John K. Gilbert,et al.  Visualization: A Metacognitive Skill in Science and Science Education , 2005 .

[136]  Roger Johansson,et al.  Pictures and Spoken Descriptions Elicit Similar Eye Movements During Mental Imagery, Both in Light and in Complete Darkness , 2006, Cogn. Sci..

[137]  Lawrence J. Najjar.  Principles of Educational Multimedia User Interface Design , 1998, Hum. Factors.

[138]  K. Holyoak,et al.  Cognitive Supports for Analogies in the Mathematics Classroom , 2007, Science.

[139]  A. Baroody,et al.  An Alternative Reconceptualization of Procedural and Conceptual Knowledge. , 2007 .

[140]  Stephen M. Kosslyn,et al.  Elements of graph design , 1993 .

[141]  A. Miyake,et al.  The separability of working memory resources for spatial thinking and language processing: an individual differences approach. , 1996, Journal of experimental psychology. General.

[142]  A. Miyake,et al.  The Cambridge Handbook of Visuospatial Thinking , 2005 .

[143]  R. Mayer,et al.  Interactive Multimodal Learning Environments , 2007 .

[144]  Michael Twyman,et al.  Using Pictorial Language: A Discussion of the Dimensions of the Problem , 1985 .

[145]  Jiajie Zhang,et al.  The Nature of External Representations in Problem Solving , 1997, Cogn. Sci..

[146]  David H. Jonassen,et al.  Handbook of Research for educational Communications and Technology , 1997 .

[147]  Detlev Leutner,et al.  Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities , 2003, Comput. Hum. Behav..

[148]  David J. Staley.  Computers, Visualization and History: How New Technology Will Transform Our Understanding of the Past , 2002 .

[149]  Patrick W Thompson,et al.  Concrete materials and teaching for mathematical understanding , 1994 .

[150]  Laurie D. Edwards,et al.  Children's learning in a computer microworld for transformation geometry , 1989 .

[151]  Michael P. Kaschak,et al.  Activity and Imagined Activity Can Enhance Young Children's Reading Comprehension. , 2004 .