Tutorials in eLearning—How Presentation Affects Outcomes

The presentation of learning materials affects how we learn. In this paper, we use eye tracking to investigate how different sequences of text and test questions affect performance outcomes, eye movements, and reading behavior for first (L1) English language and second (L2) English language readers. We show that different presentation sequences induce different performance outcomes, eye movements, and reading behavior. The sequence can affect how a participant reads the text as well as their perceptions of how well they understood what they read. For instance, if questions and text are not shown together, this improves participants’ ability to accurately perceive their comprehension and promotes thorough reading. Alternatively, showing questions before the text promotes skimming behavior. Importantly, the presentation sequence affects both L1 and L2 readers in the same way. We observe that L2 reader take longer to read text but have the same comprehension levels as L1 readers; this difference comes primarily from longer fixation durations. The results from this paper can be used to design learning materials in eLearning environments to influence how students interact with the learning environment as well as how they learn. The purpose of this investigation is to make informative decisions about designing adaptive eLearning environments.

[1]  Herman Dwi Surjono The Evaluation of a Moodle Based Adaptive e-Learning System , 2014 .

[2]  B. Sparrow,et al.  Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips , 2011, Science.

[3]  Tzyy-Ping Jung,et al.  Eye movements predict students' computer-based assessment performance of physics concepts in different presentation modalities , 2014, Comput. Educ..

[4]  Dana McKay,et al.  A jump to the left (and then a step to the right): reading practices within academic ebooks , 2011, OZCHI.

[5]  Christian Gütl,et al.  AdeLE (Adaptive e-Learning with Eye-Tracking): Theoretical Background, System Architecture and Application Scenarios , 2005 .

[6]  Tomoko Traphagan,et al.  Impact of class lecture webcasting on attendance and learning , 2010 .

[7]  David Beymer,et al.  WebGazeAnalyzer: a system for capturing and analyzing web reading behavior using eye gaze , 2005, CHI Extended Abstracts.

[8]  Anne Mangen,et al.  Reading linear texts on paper versus computer screen: Effects on reading comprehension , 2013 .

[9]  G E Legge,et al.  Psychophysics of reading. XV: Font effects in normal and low vision. , 1996, Investigative ophthalmology & visual science.

[10]  Andrew Olney,et al.  Gaze tutor: A gaze-reactive intelligent tutoring system , 2012, Int. J. Hum. Comput. Stud..

[11]  John L. Sibert,et al.  The reading assistant: eye gaze triggered auditory prompting for reading remediation , 2000, UIST '00.

[12]  Alexandros Paramythis,et al.  Adaptive Learning Environments and e-Learning Standards. , 2004 .

[13]  Manuel A. Sánchez-Montañés,et al.  Towards Inferring Sequential-Global Dimension of Learning Styles from Mouse Movement Patterns , 2008, AH.

[14]  Peter Lach,et al.  Intelligent Tutoring Systems Measuring Student's Effort During Assessment , 2013, Canadian Conference on AI.

[15]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[16]  Huei-Tse Hou,et al.  Visual attention for solving multiple-choice science problem: An eye-tracking analysis , 2012, Comput. Educ..

[17]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[18]  Andreas Dengel,et al.  Eye movements as implicit relevance feedback , 2008, CHI Extended Abstracts.

[19]  Ian Pitt,et al.  Intelligent Mobile Learning Systems for Learners with Style , 2013 .

[20]  Paul P. Maglio,et al.  A robust algorithm for reading detection , 2001, PUI '01.

[21]  Marco Porta,et al.  e5Learning, an E-Learning Environment Based on Eye Tracking , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[22]  Ziming Liu,et al.  Reading behavior in the digital environment: Changes in reading behavior over the past ten years , 2005, J. Documentation.

[23]  Tamás D. Gedeon,et al.  The effect of subject familiarity on comprehension and eye movements during reading , 2013, OZCHI.

[24]  Christina M. Steiner,et al.  GRAPPLE : learning management systems meet adaptive learning environments , 2013 .

[25]  Elizabeth Ligon Bjork,et al.  Pretesting with Multiple-choice Questions Facilitates Learning , 2011, CogSci.

[26]  K. Rayner,et al.  Eye Movements as Reflections of Comprehension Processes in Reading , 2006 .

[27]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[28]  Haijun Kang Understanding online reading through the eyes of first and second language readers: An exploratory study , 2014, Comput. Educ..

[29]  Andrew Dillon,et al.  Reading from paper versus screens: a critical review of the empirical literature , 1992 .

[30]  J. Dunlosky,et al.  Metacomprehension A Brief History and How to Improve Its Accuracy , 2007 .

[31]  Mike Rinck,et al.  Chapter 16 – Eye Movement Measures to Study Global Text Processing , 2003 .

[32]  Barbara S. Chaparro,et al.  So, What Size and Type of Font Should I Use on My Website? , 2000 .

[33]  G. McConkie,et al.  The span of the effective stimulus during a fixation in reading , 1975 .

[34]  A. Dillon,et al.  Hypermedia as an Educational Technology: A Review of the Quantitative Research Literature on Learner Comprehension, Control, and Style , 1998 .

[35]  Ruth Woodfield,et al.  Gender differences in undergraduate attendance rates , 2006 .

[36]  Aidan Kehoe,et al.  Using eye tracking technology to identify visual and verbal learners , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[37]  Andrew Dillon,et al.  Designing Usable Electronic Text: Ergonomic Aspects Of Human Information Usage , 1994 .

[38]  Jack M. Fletcher,et al.  Measuring Reading Comprehension , 2006 .

[39]  Leana Copeland,et al.  Measuring reading comprehension using eye movements , 2013, 2013 IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom).

[40]  Chih-Ming Chen,et al.  Intelligent web-based learning system with personalized learning path guidance , 2008, Comput. Educ..

[41]  Jo-Anne LeFevre,et al.  Cognitive load in hypertext reading: A review , 2007, Comput. Hum. Behav..

[42]  Herman Dwi Surjono The Design of Adaptive E-Learning System based on Student ’ s Learning Styles , 2011 .

[43]  Geoffrey Underwood,et al.  Eye Fixations Predict Reading Comprehension: The Relationships between Reading Skill, Reading Speed, and Visual Inspection , 1990, Language and speech.

[44]  Catherine C. Marshall,et al.  Turning the page on navigation , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[45]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[46]  Marco Porta,et al.  Gaze behavior analysis in multiple-answer tests: An Eye tracking investigation , 2013, 2013 12th International Conference on Information Technology Based Higher Education and Training (ITHET).

[47]  Nawaz Khan,et al.  DAEL Framework: A New Adaptive E-learning Framework for Students with Dyslexia , 2015, ICCS.

[48]  Tamás D. Gedeon,et al.  Academic Articles on the Web: Reading Patterns and Formats , 2000, Int. J. Hum. Comput. Interact..

[49]  Kenton O'Hara,et al.  A comparison of reading paper and on-line documents , 1997, CHI.

[50]  D. Romer,et al.  Do Students Go to Class? Should They? , 1993 .

[51]  Brian P. Bailey,et al.  Using Eye Gaze Patterns to Identify User Tasks , 2004 .

[52]  S. Martinez-Conde Fixational eye movements in normal and pathological vision. , 2006, Progress in brain research.

[53]  Päivi Majaranta,et al.  Design issues of iDICT: a gaze-assisted translation aid , 2000, ETRA.

[54]  Mark A. Horney,et al.  Supported eText: Assistive technology through text transformations , 2007 .

[55]  Peter Z. Orton,et al.  An eye tracking study of how font size and type influence online reading , 2008, BCS HCI.

[56]  Amanda J. Rockinson-Szapkiw,et al.  Electronic versus traditional print textbooks: A comparison study on the influence of university students' learning , 2013, Comput. Educ..

[57]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.