Impact of English Reading Comprehension Abilities on Processing Magazine Style Narrative Visualizations and Implications for Personalization

In this paper, we present research to uncover how the level of reading comprehension abilities impacts how users process textual documents in English with embedded visualizations (i.e., Magazine Style Narrative Visualizations or MSNVs). We analyze performance and gaze data of users processing MSNVs from two user studies, one run in Canada and one in a non-English speaking European country. Our findings provide important insights toward developing automatic, real-time support to MSNV processing personalized according to users' English reading comprehension abilities.

[1]  Cristina Conati,et al.  Eye Tracking to Understand User Differences in Visualization Processing with Highlighting Interventions , 2014, UMAP.

[2]  Andrew Olney,et al.  Gaze tutor: A gaze-reactive intelligent tutoring system , 2012, Int. J. Hum. Comput. Stud..

[3]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[4]  U. Ammon.  English Next. Why global English may mean the end of 'English as a Foreign Language.' , 2008 .

[5]  Sébastien Lallé,et al.  Impact of Individual Differences on User Experience with a Visualization Interface for Public Engagement , 2017, UMAP '17.

[6]  Cristina Conati,et al.  Exploring the role of individual differences in information visualization , 2008, AVI '08.

[7]  Slava Kalyuga,et al.  Managing Cognitive Load in Adaptive Multimedia Learning , 2008 .

[8]  M. Just,et al.  Constructing mental models of machines from text and diagrams. , 1993 .

[9]  Mária Bieliková,et al.  Eye-tracking en masse: Group user studies, lab infrastructure, and practices , 2018, Journal of eye movement research.

[10]  G. Hutcheson.  The Multivariate Social Scientist , 1999 .

[11]  Cristina Conati,et al.  Evaluating the Impact of User Characteristics and Different Layouts on an Interactive Visualization for Decision Making , 2014, Comput. Graph. Forum.

[12]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[13]  Cristina Conati,et al.  Prediction of Users' Learning Curves for Adaptation while Using an Information Visualization , 2015, IUI.

[14]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[15]  E. Salas,et al.  Human Factors : The Journal of the Human Factors and Ergonomics Society , 2012 .

[16]  Kawa Nazemi,et al.  Adaptive Semantic Visualization for Bibliographic Entries , 2013, ISVC.

[17]  Peter Brusilovsky,et al.  Inferring word relevance from eye-movements of readers , 2011, IUI '11.

[18]  Mary C. Dyson,et al.  The influence of reading speed and line length on the effectiveness of reading from screen , 2001, Int. J. Hum. Comput. Stud..

[19]  Paul Chandler,et al.  Levels of Expertise and Instructional Design , 1998, Hum. Factors.

[20]  Tamara Munzner,et al.  Visualization Analysis and Design , 2014, A.K. Peters visualization series.

[21]  Zhen Wen,et al.  Behavior-driven visualization recommendation , 2009, IUI.

[22]  Maneesh Agrawala,et al.  Extracting references between text and charts via crowdsourcing , 2014, CHI.

[23]  Beate Grawemeyer,et al.  Evaluation of ERST - An External Representation Selection Tutor , 2006, Diagrams.

[24]  O. Spreen,et al.  Predicting premorbid IQ: A revision of the national adult reading test , 1989 .

[25]  Pascual Martínez-Gómez,et al.  Recognition of understanding level and language skill using measurements of reading behavior , 2014, IUI.

[26]  Cristina Conati,et al.  Highlighting interventions and user differences: informing adaptive information visualization support , 2014, CHI.

[27]  Huahai Yang,et al.  Personality as a Predictor of User Strategy: How Locus of Control Affects Search Strategies on Tree Visualizations , 2015, CHI.

[28]  J. Alderson.  Assessing Reading: Acknowledgements , 2000 .

[29]  Human Factors ( HF ) ; Guidelines on the multimodality of icons , symbols and pictograms , 2022 .

[30]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[31]  Cristina Conati,et al.  User Task Adaptation in Multimedia Presentations , 2013, UMAP Workshops.

[32]  Allison J. Jaeger,et al.  The Cambridge Handbook of Multimedia Learning: The Individual Differences in Working Memory Capacity Principle in Multimedia Learning , 2014 .

[33]  Erol Özçelik,et al.  Why does signaling enhance multimedia learning? Evidence from eye movements , 2010, Comput. Hum. Behav..

[34]  H. Ritter,et al.  Processing and Integrating Multimodal Material — The Influence of Color-Coding , 2005 .

[35]  Marilyn Tremaine,et al.  Understanding visualization through spatial ability differences , 2005, VIS 05. IEEE Visualization, 2005..

[36]  Cristina Conati,et al.  Individual user characteristics and information visualization: connecting the dots through eye tracking , 2013, CHI.

[37]  Cristina Conati,et al.  User-adaptive Support for Processing Magazine Style Narrative Visualizations: Identifying User Characteristics that Matter , 2018, IUI.

[38]  Sidney K. D'Mello,et al.  Zone out no more: Mitigating mind wandering during computerized reading , 2017, EDM.

[39]  Jason Lankow,et al.  Infographics: The Power of Visual Storytelling , 2012 .

[40]  T. Gog.  The signaling (or cueing) principle in multimedia learning , 2014 .

[41]  Cristina Conati,et al.  Towards adaptive information visualization: on the influence of user characteristics , 2012, UMAP.

[42]  S. Shyam Sundar,et al.  Make it Simple, or Force Users to Read?: Paraphrased Design Improves Comprehension of End User License Agreements , 2016, CHI.

[43]  John Sweller,et al.  The Split-Attention Effect , 2011 .

[44]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[45]  Jana Holsanova,et al.  Theoretical and Instructional Aspects of Learning with Visualizations , 2011 .

[46]  O. Selnes.  A Compendium of Neuropsychological Tests , 1991, Neurology.

[47]  Mirko Meboldt,et al.  Automating Areas of Interest Analysis in Mobile Eye Tracking Experiments based on Machine Learning , 2018, Journal of eye movement research.

[48]  Ulrich Ammon,et al.  David Graddol. English Next. Why global English may mean the end of ‘English as a Foreign Language.’ , 2008 .