PeyeDF: an Eye-Tracking Application for Reading and Self-Indexing Research

PeyeDF is a Portable Document Format (PDF) reader with eye tracking support, available as free and open source software. It is especially useful to researchers investigating reading and learning phenomena, as it integrates PDF reading-related behavioural data with gaze-related data. It is suitable for short and long-term research and supports multiple eye tracking systems. We utilised it to conduct an experiment which demonstrated that features obtained from both gaze and reading data collected in the past can predict reading comprehension which takes place in the future. PeyeDF also provides an integrated means for data collection and indexing using the DiMe personal data storage system. It is designed to collect data in the background without interfering with the reading experience, behaving like a modern lightweight PDF reader. Moreover, it supports annotations, tagging and collaborative work. A modular design allows the application to be easily modified in order to support additional eye tracking protocols and run controlled experiments. We discuss the implementation of the software and report on the results of the experiment which we conducted with it.

[1]  Andreas Henelius,et al.  MIDAS: Open-source framework for distributed online analysis of data streams , 2018, SoftwareX.

[2]  R. Fowler,et al.  Effectiveness of highlighting for retention of text material. , 1974 .

[3]  Juan Pablo Hourcade,et al.  Rethinking Reading for Age From Paper and Computers , 2011, Int. J. Hum. Comput. Interact..

[4]  Cristina Conati,et al.  Predicting Confusion in Information Visualization from Eye Tracking and Interaction Data , 2016, IJCAI.

[5]  Thomas S. Tullis,et al.  Generation Y, web design, and eye tracking , 2010, Int. J. Hum. Comput. Stud..

[6]  Markus Koskela,et al.  Digital Me: Controlling and Making Sense of My Digital Footprint , 2016, Symbiotic.

[7]  Kim Marriott,et al.  What academics want when reading digitally , 2014, DocEng '14.

[8]  Anne Mangen,et al.  Reading linear texts on paper versus computer screen: Effects on reading comprehension , 2013 .

[9]  Fernando De la Torre,et al.  Facing Imbalanced Data--Recommendations for the Use of Performance Metrics , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[10]  Christopher A. Dickinson,et al.  Coordinating cognition: The costs and benefits of shared gaze during collaborative search , 2008, Cognition.

[11]  Bertrand Schneider,et al.  Real-time mutual gaze perception enhances collaborative learning and collaboration quality , 2013, International Journal of Computer-Supported Collaborative Learning.

[12]  Patrick Jermann,et al.  Displaying Teacher's Gaze in a MOOC: Effects on Students' Video Navigation Patterns , 2015, EC-TEL.

[13]  M. Fine,et al.  Waterpipe smoking among U.S. university students. , 2013, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[14]  Andreas Bulling,et al.  EyeTab: model-based gaze estimation on unmodified tablet computers , 2014, ETRA.

[15]  M. Hagger,et al.  The effectiveness of a motivational interviewing primary-care based intervention on physical activity and predictors of change in a disadvantaged community , 2012, Journal of Behavioral Medicine.

[16]  Arthur C. Graesser,et al.  Moment-To-Moment Emotions During Reading , 2012 .

[17]  A. Bener.  The Impact of Asthma and Allergic Diseases on Schoolchildren: Are They at Increased Risk of Absenteeism and Poor School Performance? , 2011 .

[18]  P. Good,et al.  Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses , 1995 .

[19]  Thomas G. Dietterich,et al.  TaskTracer: a desktop environment to support multi-tasking knowledge workers , 2005, IUI.

[20]  Daniel C. Richardson,et al.  Eye movements in language and cognition , 2007 .

[21]  Arthur M. Jacobs,et al.  OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs , 2008, Behavior research methods.

[22]  J. Andrews,et al.  Acceptability of Psychotherapy, Pharmacotherapy, and Self-Directed Therapies in Australians Living with Chronic Hepatitis C , 2013, Journal of Clinical Psychology in Medical Settings.

[23]  Paul P. Maglio,et al.  A robust algorithm for reading detection , 2001, PUI '01.

[24]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[25]  Sakari Taipale,et al.  The affordances of reading/writing on paper and digitally in Finland , 2014, Telematics Informatics.

[26]  Tianyi Zhang,et al.  How Old Do You Look? Inferring Your Age from Your Gaze , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[27]  Thomas Ertl,et al.  VarifocalReader — In-Depth Visual Analysis of Large Text Documents , 2014, IEEE Transactions on Visualization and Computer Graphics.

[28]  Christine Ros,et al.  Eye and Pen: A new device for studying reading during writing , 2006, Behavior research methods.

[29]  Bill N. Schilit,et al.  Beyond paper: supporting active reading with free form digital ink annotations , 1998, CHI.

[30]  Hiroyuki Sogo,et al.  GazeParser: an open-source and multiplatform library for low-cost eye tracking and analysis , 2012, Behavior Research Methods.

[31]  Georg Buscher,et al.  Gaze-Based Filtering of Relevant Document Segments , 2009 .

[32]  Robin K. Morris,et al.  Processing Subject and Object Relative Clauses: Evidence from Eye Movements , 2002 .

[33]  Susan Brennan,et al.  Another person's eye gaze as a cue in solving programming problems , 2004, ICMI '04.

[34]  Bonita Sharif,et al.  iTrace: enabling eye tracking on software artifacts within the IDE to support software engineering tasks , 2015, ESEC/SIGSOFT FSE.

[35]  Wei Cheng,et al.  A comparison of reading comprehension across paper, computer screens, and tablets: Does tablet familiarity matter? , 2014, Journal of Computers in Education.

[36]  Katharina Scheiter,et al.  Eye tracking as a tool to study and enhance multimedia learning , 2010 .

[37]  Gal Ben-Yehudah,et al.  The Influence of Text Annotation Tools on Print and Digital Reading Comprehension , 2014 .

[38]  Paul Dourish,et al.  Presto: an experimental architecture for fluid interactive document spaces , 1999, TCHI.

[39]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[40]  L. Itti,et al.  Defending Yarbus: eye movements reveal observers' task. , 2014, Journal of vision.

[41]  J. Beatty,et al.  The pupillary system. , 2000 .

[42]  B. L. Harrison,et al.  E-books and the future of reading , 2000 .

[43]  Dongheng Li,et al.  openEyes: a low-cost head-mounted eye-tracking solution , 2006, ETRA.

[44]  K. Rayner,et al.  Eye Movements as Reflections of Comprehension Processes in Reading , 2006 .

[45]  Janne Heikkilä,et al.  Predicting the Valence of a Scene from Observers’ Eye Movements , 2015, PloS one.

[46]  R. Näsänen,et al.  Eye movements in the visual search of word lists , 2002, Vision Research.

[47]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[48]  Carrick C. Williams,et al.  To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes , 2001, Psychonomic bulletin & review.

[49]  Marcus R. Watson,et al.  Extremely selective attention: eye-tracking studies of the dynamic allocation of attention to stimulus features in categorization. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[50]  Wiebke Wagner,et al.  Steven Bird, Ewan Klein and Edward Loper: Natural Language Processing with Python, Analyzing Text with the Natural Language Toolkit , 2010, Lang. Resour. Evaluation.

[51]  Kai Kunze,et al.  Towards inferring language expertise using eye tracking , 2013, CHI Extended Abstracts.

[52]  Christian Gütl,et al.  AdeLE (Adaptive e-Learning with Eye-Tracking): Theoretical Background, System Architecture and Application Scenarios , 2005 .

[53]  Kenton O'Hara,et al.  A diary study of work-related reading: design implications for digital reading devices , 1998, CHI.

[54]  Stephanie L. Fowler,et al.  Choice and placebo expectation effects in the context of pain analgesia , 2012, Journal of Behavioral Medicine.

[55]  Roel Vertegaal,et al.  The GAZE groupware system: mediating joint attention in multiparty communication and collaboration , 1999, CHI '99.

[56]  Jorma Laaksonen,et al.  Preliminary Studies on Personalized Preference Prediction from Gaze in Comparing Visualizations , 2016, ISVC.

[57]  Andreas Dengel,et al.  Attentive documents: Eye tracking as implicit feedback for information retrieval and beyond , 2012, TIIS.

[58]  Patrick L Conroy.  My Reading Life , 2010 .

[59]  Rakefet Ackerman,et al.  Metacognitive regulation of text learning: on screen versus on paper. , 2011, Journal of experimental psychology. Applied.

[60]  T. Loetscher,et al.  Eye Movements During Everyday Behavior Predict Personality Traits , 2018, Front. Hum. Neurosci..

[61]  Alan F. Smeaton,et al.  LifeLogging: Personal Big Data , 2014, Found. Trends Inf. Retr..

[62]  Susan T. Dumais,et al.  Stuff I've Seen: A System for Personal Information Retrieval and Re-Use , 2003, SIGF.

[63]  Pierre Dillenbourg,et al.  This is it ! : Indicating and looking in collaborative work at distance , 2010 .

[64]  Thiago Santini,et al.  EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking , 2016, VISIGRAPP.

[65]  Ziming Liu,et al.  Reading behavior in the digital environment: Changes in reading behavior over the past ten years , 2005, J. Documentation.

[66]  Andreas Dengel,et al.  The eyeBook – Using Eye Tracking to Enhance the Reading Experience , 2010, Informatik-Spektrum.

[67]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.