Development of Dynamic Usage of Strategies for Integrating Text and Picture Information in Secondary Schools

Students are frequently required to integrate text and picture information into coherent knowledge structures. This raises the questions of how students deal with texts and how they deal with graphics when they try to integrate the two sources of information, and whether there are differences between students from different school types and grades. Forty students from Grades 5 and 8, from higher and lower tiers of the German school system, were asked to process and integrate text and pictures in order to answer items from different hierarchy-levels of a text-picture integration taxonomy. Students’ eye movements were recorded and analyzed. Results suggest a fundamental asymmetry between the functions of text and pictures, associated with different processing strategies. Texts are more likely to be used according to a coherence-formation strategy, whereas pictures are more likely to be used on demand as visual cognitive tools according to an information selection strategy. Students from different tiers of schooling revealed different adaptability with regard to the requirements of combining text and graphic information.

[1]  Hope J. Hartman Metacognition in learning and instruction : theory, research and practice , 2001 .

[2]  Danielle S. McNamara Reading comprehension strategies : theories, interventions, and technologies , 2007 .

[3]  Raymond W. Kulhavy,et al.  How geographic maps increase recall of instructional text , 1993 .

[4]  R. Mayer,et al.  Multimedia Learning: Frontmatter , 2001 .

[5]  Hope J. Hartman Metacognition in Learning and Instruction , 2001 .

[6]  Peter R. Denner,et al.  Inserted questions as aids to reading text , 1978 .

[7]  Shaaron Ainsworth,et al.  The functions of multiple representations , 1999, Comput. Educ..

[8]  J. Mokros,et al.  The impact of microcomputer‐based labs on children's ability to interpret graphs , 1987 .

[9]  W. Howard Levie,et al.  Effects of text illustrations: A review of research , 1982 .

[10]  Wolfgang Schnotz,et al.  The Cambridge Handbook of Multimedia Learning: An Integrated Model of Text and Picture Comprehension , 2005 .

[11]  R. Kail,et al.  Perspectives on the development of memory and cognition , 1977 .

[12]  Bernd Weidenmann 9 When Good Pictures Fail: An Information-Processing Approach to the Effect of Illustrations , 1989 .

[13]  Jürgen Baumert,et al.  What makes text-picture-integration difficult? A structural and procedural analysis of textbook requirements , 2011 .

[14]  Reinhold Kliegl,et al.  childLex: a lexical database of German read by children , 2014, Behavior Research Methods.

[15]  April L. Zenisky,et al.  Identification and Evaluation of Local Item Dependencies in the Medical College Admissions Test , 2002 .

[16]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[17]  Howard Wainer,et al.  Understanding Graphs and Tables , 1992 .