An integrative study on learning and testing with multimedia: Effects on students’ performance and metacognition

Abstract Previous research has found that adding pictures to either text-based learning- or testing-materials has beneficial effects (i.e., multimedia effects in learning and testing). However, a potential interaction of multimedia effects in learning and in testing has scarcely been the focus of research so far. Accordingly, in the present experiment, N = 129 university students received text-based material that was either complemented by pictures both in learning and testing (P-P), only in learning and not in testing (P-T), in testing but not in learning (T-P), or not at all (T-T). Students performed better in the P-P condition than in the other three conditions (P-T, T-P, T-T). Differences between the latter three conditions were not significant. Thus, pictures needed to be present in both learning and testing to foster students' performance. Nonetheless, pictures boosted students’ confidence even if performance was not actually improved, thereby underlining the risk of picture-induced metacognitive bias.

[1]  Alexander Eitel,et al.  Identifying processes underlying the multimedia effect in testing: An eye-movement analysis , 2017 .

[2]  Marcus Nyström,et al.  How a picture facilitates the process of learning from text: Evidence for scaffolding , 2013 .

[3]  John Dunlosky,et al.  Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention , 2012 .

[4]  Michael C. Rodriguez,et al.  Developing and Validating Test Items , 2013 .

[5]  Marlit Annalena Lindner,et al.  Tracking the Decision-Making Process in Multiple-Choice Assessment: Evidence from Eye Movements , 2014 .

[6]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[7]  Allison J. Jaeger,et al.  Do illustrations help or harm metacomprehension accuracy , 2014 .

[8]  S. Ainsworth.  DeFT: A Conceptual Framework for Considering Learning with Multiple Representations. , 2006 .

[9]  K. Scheiter,et al.  Signals foster multimedia learning by supporting integration of highlighted text and diagram elements , 2015 .

[10]  Tamara van Gog,et al.  Improving self-monitoring and self-regulation: From cognitive psychology to the classroom , 2012 .

[11]  O. Lüdtke,et al.  The merits of representational pictures in educational assessment: Evidence for cognitive and motivational effects in a time-on-task analysis , 2017 .

[12]  W. Howard Levie,et al.  Effects of text illustrations: A review of research , 1982 .

[13]  Jörg Wittwer,et al.  Pictures in Test Items: Effects on Response Time and Response Correctness , 2012 .

[14]  W. Schnotz,et al.  The role of decorative pictures in learning , 2013 .

[15]  Peter Gerjets,et al.  Extending multimedia research: How do prerequisite knowledge and reading comprehension affect learning from text and pictures , 2014, Comput. Hum. Behav..

[16]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[17]  Alexander Eitel,et al.  How repeated studying and testing affects multimedia learning: Evidence for adaptation to task demands , 2016 .

[18]  Katharina Scheiter,et al.  Implementation intentions during multimedia learning: Using if-then plans to facilitate cognitive processing , 2015 .

[19]  Marlit Annalena Lindner,et al.  Test-takers' eye movements: Effects of integration aids and types of graphical representations , 2017, Comput. Educ..

[20]  Katharina Scheiter,et al.  The Time Course of Information Extraction from Instructional Diagrams , 2012, Perceptual and motor skills.

[21]  W. Schnotz.  Integrated Model of Text and Picture Comprehension , 2021, The Cambridge Handbook of Multimedia Learning.

[22]  J. D. Fletcher,et al.  The Multimedia Principle. , 2005 .

[23]  Katharina Scheiter,et al.  Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis , 2016 .

[24]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[25]  Hsin-Kai Wu,et al.  What makes an item more difficult? Effects of modality and type of visual information in a computer-based assessment of scientific inquiry abilities , 2015, Comput. Educ..

[26]  M. A. Lindner,et al.  How Representational Pictures Enhance Students’ Performance and Test-Taking Pleasure in Low-Stakes Assessment , 2018, European Journal of Psychological Assessment.

[27]  John Sweller,et al.  The Split-Attention Principle in Multimedia Learning , 2021, The Cambridge Handbook of Multimedia Learning.

[28]  Detlev Leutner,et al.  Mentale Modelle und Effekte der Präsentations- und Abrufkodalität beim Lernen mit Multimedia , 2001 .

[29]  Patricia A. Alexander,et al.  Calibration: What Is It and Why It Matters? An Introduction to the Special Issue on Calibrating Calibration. , 2013 .

[30]  Michael J. Serra,et al.  Metacomprehension judgements reflect the belief that diagrams improve learning from text , 2010, Memory.

[31]  Yvonne Kammerer,et al.  The effects of realism in learning with dynamic visualizations , 2009 .

[32]  A. Paivio.  Mental Representations: A Dual Coding Approach , 1986 .

[33]  Marcus Nyström,et al.  There’s more to the multimedia effect than meets the eye: is seeing pictures believing? , 2017, 1706.03998.

[34]  Katharina Scheiter,et al.  Picture or Text First? Explaining Sequence Effects when Learning with Pictures and Text , 2015 .

[35]  Colleen M. Kelley,et al.  Solve the problem first: constructive solution strategies can influence the accuracy of retrospective confidence judgments. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[36]  P. Spargo,et al.  Construction of a paper-and-pencil Test of Basic Scientific Literacy based on selected literacy goals recommended by the American Association for the Advancement of Science , 1996 .

[37]  Barbara Colombo,et al.  Metacognition in self-regulated multimedia learning: integrating behavioural, psychophysiological and introspective measures , 2015 .

[38]  Elizabeth Haseltine,et al.  Metamemory , 2021, Encyclopedia of Animal Cognition and Behavior.

[39]  Gijsbert Erkens,et al.  Avoiding split attention in computer-based testing: Is neglecting additional information facilitative? , 2015, Br. J. Educ. Technol..

[40]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[41]  Wolfgang Schnotz,et al.  The Cambridge Handbook of Multimedia Learning: An Integrated Model of Text and Picture Comprehension , 2005 .

[42]  R. Bjork,et al.  Self-regulated learning: beliefs, techniques, and illusions. , 2013, Annual review of psychology.

[43]  Gary J. Anglin,et al.  On Empirically Validating Functions of Pictures in Prose , 1987 .