Navigating the Narrative: An Eye‐Tracking Study of Reader's Strategies When Reading Comic Page Layouts

In multimedia stimuli (e.g., comics), the reader must follow a narrative in which text and image both contribute information, and artists may use more irregular layouts which must still be followed correctly. While previous work has found that the exter-nal structure (outlines) of panels is a major contributor to navigation decisions in comics, other studies have shown that panel content can affect reading order. The present studies use eye-tracking to investigate these contributions further. In Experiment 1, the reading behaviors on six layout variations were compared. The influence of the external structure was replicated, but an effect of text location was also found for one layout type. Experiment 2 focused on variations of this particular layout, manipulating the location of text within critical panels. Panel content was a consistent effect for all variations. While most navigation decisions are made using the external structure, content becomes key when resolving ambiguous layouts.

[1]  Phillip Vaughan,et al.  Reading Words and Images , 2018, Empirical Comics Research.

[2]  T. Slattery,et al.  Word skipping: Effects of word length, predictability, spelling and reading skill , 2018, Quarterly journal of experimental psychology.

[3]  T. Foulsham,et al.  Reading Without Words: Eye Movements in the Comprehension of Comic Strips , 2016 .

[4]  Neil Cohn,et al.  Navigating Comics II: Constraints on the Reading Order of Comic Page Layouts , 2015 .

[5]  Barbara Postema Narrative Structure in Comics: Making Sense of Fragments , 2013 .

[6]  Neil Cohn,et al.  Navigating Comics: An Empirical and Theoretical Approach to Strategies of Reading Comic Page Layouts , 2013, Front. Psychol..

[7]  Hsueh-Cheng Wang,et al.  The attraction of visual attention to texts in real-world scenes. , 2012, Journal of vision.

[8]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[9]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[10]  Jessica Abel,et al.  Drawing Words & Writing Pictures: Making Comics: Manga, Graphic Novels, and Beyond , 2008 .

[11]  A. Lewis Making Comics: Storytelling Secrets of Comics, Manga and Graphic Novels , 2007 .

[12]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[13]  Andrew J. Stewart,et al.  Integrating text and pictorial information: eye movements when looking at print advertisements. , 2001, Journal of experimental psychology. Applied.

[14]  A. Manning,et al.  Understanding Comics: The Invisible Art , 2018 .

[15]  Stephen Politzer-Ahles,et al.  An extension of within-subject confidence intervals to models with crossed random effects , 2017 .

[16]  David Letterman,et al.  Toward a Theory of Comic Book Communication , 2011 .

[17]  Takahide Omori・Takeharu Igaki Eye catchers in comics: Controlling eye movements in reading pictorial and textual media , 2005 .

[18]  P. Carroll,et al.  Visual Analysis of Cartoons: A View from the Far Side , 1992 .