Do Films Make You Learn? Inference Processes in Expository Film Comprehension

The present article examines how suitable expository films are for learning. This question was motivated by the assumption that films are processed in a superficial manner. However, previous research has been dominated by the analyses of outcome measures and has never taken a look at online measures so that no clear conclusions have been drawn. Experiment 1 analyzed online local causal bridging inferences that are crucial for the understanding of complex scientific matters. Using a naming paradigm, it could be demonstrated that local causal bridging inferences are generated during film reception. This holds true for film viewers and audiotape listeners. Experiment 2 analyzed whether participants were able to integrate the inferred information into a coherent mental model. We found that for at least one item set, both film viewers and audiotape listeners integrated implicit information into a mental model. To further clarify the role of the pictorial information in films for the comprehension process, Experiment 3 analyzed the extent to which pictorial information can compensate for coherence breaks due to missing verbal information in the auditory channel. We found that, on a local level, pictorial information can compensate for missing verbal information, but not on a global level.

[1]  Arthur C. Graesser,et al.  The psychology of science text comprehension , 2014 .

[2]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[3]  Murray Singer,et al.  Detecting Causal Inconsistencies in Scientific Text , 1999 .

[4]  P. Chandler,et al.  Cognitive Load Theory and the Format of Instruction , 1991 .

[5]  Arthur C. Graesser,et al.  The Construction of Causal Inferences While Reading Expository Texts on Science and Technology , 1998 .

[6]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[7]  Mitchell J. Nathan,et al.  A theory of algebra-word-problem comprehension and its implications for the design of learning environments. , 1992 .

[8]  P. Broek The causal inference maker: Towards a process model of inference generation in text comprehension. , 1990 .

[9]  A. Baddeley,et al.  Dual‐Task Paradigm: A Means To Examine the Central Executive , 1995, Annals of the New York Academy of Sciences.

[10]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[11]  Rolf A. Zwaan,et al.  Situation models in language comprehension and memory. , 1998, Psychological bulletin.

[12]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[13]  S. Kosslyn Image and mind , 1982 .

[14]  Michael B. W. Wolfe,et al.  Memory for narrative and expository text: independent influences of semantic associations and text organization. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Richard C. Anderson,et al.  The representation of sentences in memory , 1981 .

[16]  Douglas J. Hacker,et al.  Metacognition in educational theory and practice. , 1998 .

[17]  Renee Hobbs,et al.  Non‐optimal uses of video in the classroom , 2006 .

[18]  F. Paas,et al.  Memory load and the cognitive pupillary response in aging. , 2004, Psychophysiology.

[19]  Rolf A. Zwaan The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[20]  G. Salomon Television is "easy" and print is "tough": The differential investment of mental effort in learning as a function of perceptions and attributions. , 1984 .

[21]  Arthur C. Graesser,et al.  Inference generation and cohesion in the construction of situation models: Some connections with computational linguistics. , 2007 .

[22]  Marie Bienkowski,et al.  Automatic access of the meanings of ambiguous words in context: Some limitations of knowledge-based processing , 1982, Cognitive Psychology.

[23]  John Sweller,et al.  Instructional Design in Technical Areas , 1999 .

[24]  R. Mayer,et al.  How Seductive Details Do Their Damage: A Theory of Cognitive Interest in Science Learning , 1998 .

[25]  Richard K. Lowe,et al.  An Eye Tracking Comparison of External Pointing Cues and Internal Continuous Cues in Learning with Complex Animations , 2010 .

[26]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994 .

[27]  F. Hesse,et al.  Do film cuts facilitate the perceptual and cognitive organization of activitiy sequences? , 2000, Memory & cognition.

[28]  Influence of the medium on children's story apprehension. , 1980 .

[29]  Jonathan M. Golding,et al.  Methodological Issues In Evaluating The Occurrence of Inferences , 1990 .

[30]  Wolfgang Schnotz,et al.  Commentary: Towards an Integrated View of Learning from Text and Visual Displays , 2002 .

[31]  A. Paivio Mental Representations: A Dual Coding Approach , 1986 .

[32]  R. Logie Visuo-spatial Working Memory , 1994 .

[33]  S. Schwan,et al.  The cognitive benefits of interactive videos: learning to tie nautical knots , 2004 .

[34]  T. Trabasso,et al.  Minimal or Global Inference during Reading , 1994 .

[35]  K. VanLehn,et al.  Scaffolding Deep Comprehension Strategies Through Point&Query, AutoTutor, and iSTART , 2005 .

[36]  T. Salthouse,et al.  Cognition and context. , 1992, Science.

[37]  Juliette H. Walma van der Molen,et al.  Children's recall of television and print news : A media comparison study , 1997 .

[38]  A. Paivio Mental imagery in associative learning and memory , 1969 .

[39]  M. Sobel Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .

[40]  Barrie Gunter,et al.  Children's Memory for News: A Comparison of Three Presentation Media , 2000 .

[41]  M. Singer,et al.  Validation of causal bridging inferences in discourse understanding. , 1992 .

[42]  L. James,et al.  Mediators, Moderators, and Tests for Mediation. , 1984 .

[43]  M. Wittrock Handbook of research on teaching , 1986 .

[44]  R. Ratcliff,et al.  Inferences about predictable events. , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[45]  Harry Singer,et al.  Theoretical models and processes of reading , 1976 .

[46]  Stephan Schwan,et al.  Effects of presentation speed of a dynamic visualization on the understanding of a mechanical system , 2008 .

[47]  Juliette H. Walma van der Molen,et al.  Children's and Adults' Recall of Television and Print News in Children's and Adult News Formats , 2000, Commun. Res..

[48]  E. J. O'Brien,et al.  Elaborative inferencing as an active or passive process. , 1990 .

[49]  P. Broek,et al.  The effects of reading purpose and working memory capacity on the processing of expository text. , 2002 .

[50]  Tom H. A. van der Voort,et al.  Television Viewing versus Reading: Mental Effort, Retention, and Inferential Learning. , 1993 .

[51]  Murray Singer,et al.  Inference Processes: Integrating Relevant Knowledge and Text Information , 2002 .

[52]  Mark S. Seidenberg,et al.  Pre- and postlexical loci of contextual effects on word recognition , 1984, Memory & cognition.

[53]  David Bordwell Narration in the Fiction Film , 1985 .

[54]  Arthur C. Graesser,et al.  The Time-Course of Constructing Knowledge-Based Inferences for Scientific Texts , 1994 .

[55]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[56]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[57]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[58]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[59]  D. Anderson,et al.  Young children's recall and reconstruction of audio and audiovisual narratives. , 1986, Child development.

[60]  M. G. Calvo,et al.  Working memory and inferences: Evidence from eye fixations during reading , 2001, Memory.

[61]  M. Calvo Relative contribution of vocabulary knowledge and working memory span to elaborative inferences in reading , 2005 .

[62]  Elaborative Inferences on an Expository Text. , 1991 .

[63]  S. Neuman The Impact of Different Media on Children's Story Comprehension , 1989 .

[64]  R. Kozma Learning with Media , 1991 .

[65]  Sergio Della Sala,et al.  Working memory in event‐ and time‐based prospective memory tasks: Effects of secondary demand and age , 2004 .

[66]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[67]  Rolf A. Zwaan,et al.  Indexing space and time in film understanding , 2001 .

[68]  W. Kintsch,et al.  Discourse comprehension : essays in honor of Walter Kintsch , 1996 .

[69]  Pierre Dillenbourg,et al.  Learning from animation enabled by collaboration , 2010 .

[70]  Keith Rayner,et al.  Understanding Eye Movements in Reading. , 1997 .

[71]  R. Ratcliff,et al.  The activation of antecedent information during the processing of anaphoric reference in reading. , 1983 .

[72]  Arthur C. Graesser,et al.  A three-pronged method for studying inference generation in literary text , 1991 .

[73]  R. Azevedo Using Hypermedia as a Metacognitive Tool for Enhancing Student Learning? The Role of Self-Regulated Learning , 2005 .

[74]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[75]  S. Kosslyn Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[76]  Rebecca Fincher-Kiefer,et al.  The Role of Visuospatial Resources in Generating Predictive and Bridging Inferences , 2004 .

[77]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[78]  D. J. Foss,et al.  Text structure and reading time for sentences , 1980 .

[79]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[80]  Noel E. Sharkey,et al.  Weak contextual constraints in text and word priming , 1992 .

[81]  Roger Ratcliff,et al.  Inference during reading. , 1992 .

[82]  Arthur C. Graesser,et al.  Dimensions of situation model construction in narrative comprehension. , 1995 .

[83]  Paul Kaegbein,et al.  Methods in reading research , 1991 .

[84]  Arthur C. Graesser,et al.  Constructing inferences and relations during text comprehension , 2001 .

[85]  Stephen K. Reed Word Problems: Research and Curriculum Reform , 1998 .

[86]  A. Furnham,et al.  Remembering science: The recall of factual information as a function of the presentation mode , 1990 .

[87]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[88]  T. Haladyna Developing and Validating Multiple-Choice Test Items , 1994 .

[89]  S. Neuman Is Learning From Media Distinctive? Examining Children’s Inferencing Strategies , 1992 .

[90]  Barrie Gunter,et al.  Children's and adults' recall of children's news stories in both print and audio-visual presentation modalities , 2002 .

[91]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[92]  Daniel C. Richardson,et al.  Eye Movements During Comprehension of Spoken Scene Descriptions , 2000 .

[93]  Michael B. W. Wolfe,et al.  Learning and memory of factual content from narrative and expository text. , 2007, The British journal of educational psychology.

[94]  K. A. Ericsson,et al.  Protocol analysis: Verbal reports as data, Rev. ed. , 1993 .

[95]  E. J. O'Brien,et al.  Maintaining global coherence during reading , 1994 .

[96]  Murray Singer,et al.  Constructing inferences in expository text comprehension , 1997 .

[97]  Julia R. Fox A Signal Detection Analysis of Audio/Video Redundancy Effects in Television News Video , 2004, Commun. Res..

[98]  Jerome L. Myers,et al.  Availability and Accessibility of Information and Causal Inferences From Scientific Text , 2003 .

[99]  Michelle Gaddy Everson,et al.  Effects of Causal Text Revisions on More- and Less-Skilled Readers' Comprehension of Easy and Difficult Texts , 2000 .

[100]  Danielle S. McNamara,et al.  Learning from texts: Effects of prior knowledge and text coherence , 1996 .

[101]  Rolf A. Zwaan Effect of genre expectations on text comprehension. , 1994 .

[102]  Douglas Biber,et al.  Variation across speech and writing: Methodology , 1988 .

[103]  G. R. Potts,et al.  Assessing the occurrence of elaborative inferences: Lexical decision versus naming , 1988 .

[104]  Murray Singer,et al.  Constructing and Validating Motive Bridging Inferences , 1996, Cognitive Psychology.

[105]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[106]  J. L. Myers,et al.  Reinstatement of causal information during reading. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[107]  David E. Kieras,et al.  A Guide to Propositional Analysis for Research on Technical Prose. , 1981 .

[108]  Wolfgang Schnotz,et al.  The Cambridge Handbook of Multimedia Learning: An Integrated Model of Text and Picture Comprehension , 2005 .

[109]  Wolfgang Schnotz,et al.  Enabling, facilitating, and inhibiting effects of animations in multimedia learning: Why reduction of cognitive load can have negative results on learning , 2005 .

[110]  Friedrich W. Hesse,et al.  The relationship between formal filmic means and the segmentation behavior of film viewers , 1998 .

[111]  Barrie Gunter,et al.  Memory for Material Presented in the Media: The Superiority of Written Communication , 1988 .

[112]  Leo G. M. Noordman,et al.  Causal inferences during the reading of expository texts , 1992 .

[113]  J. D. Murray,et al.  Activation and Encoding of Predictive Inferences: The Role of Reading Skill , 2003 .

[114]  A. McGee,et al.  The Effect of Inference Training on Skilled and Less Skilled Comprehenders , 2003 .

[115]  Richard Lowe,et al.  Interrogation of a dynamic visualization during learning , 2004 .

[116]  David A. Balota Comprehension Processes in Reading. , 1990 .

[117]  W. Kintsch,et al.  Are Good Texts Always Better? Interactions of Text Coherence, Background Knowledge, and Levels of Understanding in Learning From Text , 1996 .

[118]  Adrian Furnham,et al.  Remembering Commercials Presented in Different Media , 1987 .

[119]  José Otero,et al.  8. Situation models as retrieval structures: effects on the global coherence of science texts , 2002 .

[120]  T. Trabasso,et al.  Causal thinking and the representation of narrative events , 1985 .

[121]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[122]  K. Forster Priming and the Effects of Sentence and Lexical Contexts on Naming Time: Evidence for Autonomous Lexical Processing* , 1981 .

[123]  Mark T. Keane,et al.  Cognitive psychology: A student's handbook, 7th ed. , 2015 .

[124]  W. Kintsch The Construction-Integration Model of Text Comprehension and Its Implications for Instruction , 2004 .

[125]  Gerhard Fischer,et al.  Cognitive tools for locating and comprehending software objects for reuse , 1991, [1991 Proceedings] 13th International Conference on Software Engineering.

[126]  Barrie Gunter,et al.  Sex, Presentation Mode and Memory for Violent and Non‐violent News , 1985 .

[127]  Barrie Gunter,et al.  The primacy of print: immediate cued recall of news as a function of the channel of communication , 1989 .

[128]  Walter Kintsch,et al.  Toward a model of text comprehension and production. , 1978 .

[129]  Donald S. Hayes,et al.  Media Differences in Children's Story Synopses: Radio and Television Contrasted. , 1986 .

[130]  Susan Palmiter,et al.  Animated Demonstrations for Learning Procedural Computer-Based Tasks , 1993, Hum. Comput. Interact..

[131]  Thomas Grimes,et al.  Audio-Visual Redundancy and TV News Recall , 1987 .

[132]  Barbara Tversky,et al.  Animation: can it facilitate? , 2002, Int. J. Hum. Comput. Stud..

[133]  Edward M. Bowden,et al.  Right and Left Hemisphere Cooperation for Drawing Predictive and Coherence Inferences during Normal Story Comprehension , 2000, Brain and Language.

[134]  M. Singer,et al.  Inferring consequences in story comprehension , 1983 .

[135]  Rebecca Fincher-Kiefer,et al.  The role of predictive inferences in situation model construction , 1993 .

[136]  J. Bryant,et al.  Psychology of entertainment , 2006 .

[137]  Susan R. Goldman,et al.  Por qué son útiles los modelos computacionales de comprensión de textos , 2007 .

[138]  R. Green REMEMBERING IDEAS FROM TEXT: THE EFFECT OF MODALITY OF PRESENTATION , 1981 .

[139]  J. D. Murray,et al.  Forward Inferences in Narrative Text , 1993 .

[140]  Mary Hegarty,et al.  Top-down and bottom-up influences on learning from animations , 2007, Int. J. Hum. Comput. Stud..

[141]  Barrie Gunter,et al.  Memory for information from a party political broadcast as a function of the channel of communication. , 1986 .

[142]  Richard K. Lowe Extracting information from an animation during complex visual learning , 1999 .

[143]  Julie C. Sedivy,et al.  Eye movements to pictures reveal transient semantic activation during spoken word recognition. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[144]  M. Gernsbacher,et al.  Investigating differences in general comprehension skill. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[145]  Cor Aarnoutse,et al.  Third-grader's think-aloud protocols : types of reading activities in reading an expository text , 2006 .

[146]  Arthur C. Graesser,et al.  The role of situational continuity in narrative understanding. , 1999 .

[147]  B. K. Britton,et al.  Using Kintsch's computational model to improve instructional text: Effects of repairing inference calls on recall and cognitive structures. , 1991 .

[148]  John B. Black,et al.  Causal coherence and memory for events in narratives , 1981 .

[149]  T. Trabasso,et al.  Inferences during Reading: Converging Evidence from Discourse Analysis, Talk-Aloud Protocols, and Recognition Priming , 1993 .

[150]  Greg Myers,et al.  Lexical cohesion and specialized knowledge in science and popular science texts , 1991 .

[151]  Darren Newtson Attribution and the unit of perception of ongoing behavior. , 1973 .

[152]  Michael J Cortese,et al.  Handbook of Psycholinguistics , 2011 .

[153]  Shuhua Zhou,et al.  Effects of Visual Intensity and Audiovisual Redundancy in Bad News , 2004 .

[154]  Barrie Gunter,et al.  Sex and personality differences in recall of violent and non-violent news from three presentation modalities , 1986 .

[155]  Adrian Furnham Remembering Stories as a Function of the Medium of Presentation , 2001, Psychological reports.

[156]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[157]  T. Grimes,et al.  Audio-video correspondence and its role in attention and memory , 1990 .

[158]  Murray Singer,et al.  Bridging-Inferences and Enthymemes , 1990 .

[159]  J. Sweller Implications of Cognitive Load Theory for Multimedia Learning , 2005, The Cambridge Handbook of Multimedia Learning.

[160]  Nat Simon,et al.  That's it , 1987 .

[161]  Arthur C. Graesser,et al.  Strategic processing during comprehension. , 1999 .

[162]  T. Trabasso,et al.  Logical necessity and transitivity of causal relations in stories , 1989 .

[163]  A. Baumgaertner,et al.  Mechanisms of discourse comprehension impairment after right hemisphere brain damage: suppression in inferential ambiguity resolution. , 2000, Journal of speech, language, and hearing research : JSLHR.

[164]  Bruce K. Britton,et al.  Executive Control Processes in Reading , 1987 .

[165]  C. Fletcher,et al.  Causal reasoning in the comprehension of simple narrative texts , 1988 .

[166]  Marcel V. J. Veenman,et al.  The assessment of metacognitive skills: what can be learned from multi-method designs? , 2005 .

[167]  Eduardo Vidal-Abarca,et al.  Some good texts are always better: text revision to foster inferences of readers with high and low prior background knowledge , 2005 .

[168]  Rolf A. Zwaan Embodied cognition, perceptual symbols, and situation models , 1999 .

[169]  Jason E. Albrecht,et al.  Updating a mental model: maintaining both local and global coherence , 1993 .

[170]  Robin K. Morris,et al.  Inferred goals in narratives: Evidence from self-paced reading, recall, and eye movements , 2003 .

[171]  Adrian Staub,et al.  Eye movements and on-line comprehension processes , 2007 .

[172]  C. Douglas Wetzel,et al.  Instructional Effectiveness of Video Media , 1994 .

[173]  Ronald G. Stansfield,et al.  Sociological Methodology 1982 , 1983 .

[174]  Evelyn C. Ferstl The functional neuroanatomy of text comprehension: what's the story so far? , 2007 .

[175]  Arthur C. Graesser,et al.  1. Introduction to the psychology of science text comprehension , 2002 .

[176]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[177]  Rolf A. Zwaan,et al.  Generating predictive inferences while viewing a movie , 1996 .

[178]  B Gunter,et al.  MEMORY FOR THE NEWS AS A FUNCTION OF THE CHANNEL OF COMMUNICATION , 1984 .

[179]  Jessica Beagles-Roos,et al.  Specific impact of radio and television on children's story comprehension. , 1983 .

[180]  M. Singer,et al.  Discourse inference processes. , 1994 .

[181]  T. Trabasso,et al.  Understanding text: Achieving explanatory coherence through on‐line inferences and mental operations in working memory , 1993 .

[182]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[183]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[184]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[185]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[186]  Richard Catrambone,et al.  A Methodological Alternative to Media Comparison Studies: Linking Information Utilization Strategies and Instructional Approach in Hypermedia Learning , 2006 .

[187]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[188]  C. Fletcher,et al.  An on-line assessment of causal reasoning during comprehension , 1990, Memory & cognition.

[189]  Lucinda D. Davenport,et al.  Audience Recall of News Stories Presented by Newspaper, Computer, Television and Radio , 1992 .

[190]  Patricia Baggett Structurally equivalent stories in movie and text and the effect of the medium on recall. , 1979 .

[191]  R. Engle Working Memory Capacity as Executive Attention , 2002 .

[192]  J. M. Golding,et al.  A test of the on-line status of goal-related inferences , 1992 .

[193]  Richard Lowe,et al.  Animation and learning: selective processing of information in dynamic graphics , 2003 .

[194]  H. Oostendorp,et al.  The Construction of Mental Representations During Reading , 1998 .

[195]  John B. Black,et al.  Types of inferences generated during reading , 1985 .