Exploring the Process of Reading During Writing Using Eye Tracking and Keystroke Logging

This study aims to explore the process of reading during writing. More specifically, it investigates whether a combination of keystroke logging data and eye tracking data yields a better understanding of cognitive processes underlying fluent and nonfluent text production. First, a technical procedure describes how writing process data from the keystroke logging program Inputlog are merged with reading process data from the Tobii TX300 eye tracker. Next, a theoretical schema on reading during writing is presented, which served as a basis for the observation context we created for our experiment. This schema was tested by observing 24 university students in professional communication (skilled writers) who typed short sentences that were manipulated to elicit fluent or nonfluent writing. The experimental sentences were organized into four different conditions, aiming at (a) fluent writing, (b) reflection about correct spelling of homophone verbs, (c) local revision, and (d) global revision. Results showed that it is possible to manipulate degrees of nonfluent writing in terms of time on task and percentage of nonfluent key transitions. However, reading behavior was affected only for the conditions that explicitly required revision. This suggests that nonfluent writing does not always affect the reading behavior, supporting the parallel and cascading processing hypothesis.

[1]  Thierry Olive,et al.  Toward a parallel and cascading model of the writing system: A review of research on writing processes coordination , 2014 .

[2]  Allen G. Harbaugh,et al.  Adolescent students’ reading during writing behaviors and relationships with text quality: an eyetracking study , 2010 .

[3]  Evgeny Chukharev-Khudilaynen,et al.  Pauses in spontaneous written communication: A keystroke logging study , 2014 .

[4]  M. Fayol,et al.  Producing written noun phrases in French , 2015 .

[5]  A. Kennedy,et al.  Parafoveal-on-foveal effects in normal reading , 2005, Vision Research.

[6]  Hugo Quené,et al.  On multi-level modeling of data from repeated measures designs: a tutorial , 2004, Speech Commun..

[7]  Joachim Grabowski,et al.  Second and fourth graders' copying ability: from graphical to linguistic processing , 2010 .

[8]  An application of multilevel analysis on writing process data , 1996 .

[9]  Vincent Connelly,et al.  Children with dyslexia are slow writers because they pause more often and not because they are slow at handwriting execution , 2013 .

[10]  Åsa Wengelin,et al.  Logging tools to study digital writing processes , 2011 .

[11]  Ibrahim Sogukpinar,et al.  Understanding users' keystroke patterns for computer access security , 2003, Comput. Secur..

[12]  R. T. Kellogg,et al.  Working memory components in written sentence generation. , 2004, The American journal of psychology.

[13]  R. T. Kellogg.  A model of working memory in writing. , 1996 .

[14]  Fabio Alves,et al.  A new window on translators' cognitive activity: methodological issues in the combined use of eye tracking, key logging and retrospective protocols , 2010 .

[15]  Victoria Johansson,et al.  Looking at the keyboard or the monitor: relationship with text production processes , 2010 .

[16]  Mariëlle Leijten,et al.  Coordinating the Cognitive Processes of Writing , 2012 .

[17]  Sharon O'Brien,et al.  Eye tracking in translation process research: methodological challenges and solutions , 2009 .

[18]  Huub van den Bergh,et al.  Effects of thinking aloud on writing processes , 1996 .

[19]  Mariëlle Leijten,et al.  Fluency in Writing: A Multidimensional Perspective on Writing Fluency Applied to L1 and L2 , 2015 .

[20]  Chris M. Anson,et al.  Tracking the Mind's Eye: A New Technology for Researching Twenty-First-Century Writing and Reading Processes. , 2012 .

[21]  Jean-Luc Velay,et al.  Motor expertise for typing impacts lexical decision performance , 2016, Trends in Neuroscience and Education.

[22]  Mariëlle Leijten,et al.  Typing competencies in Alzheimer's disease: An exploration of copy tasks , 2017, Comput. Hum. Behav..

[23]  Udo Will,et al.  Morphemes, syllables and graphemes in written word production , 2004 .

[24]  A. Gordon,et al.  Eye Movements and Eye-Hand Coordination During Typing , 1997 .

[25]  Susan Jones.  From ideas in the head to words on the page: young adolescents’ reflections on their own writing processes , 2014 .

[26]  Matt C. Keener,et al.  TRAKTEXT: Investigating writing processes using eye-tracking technology , 2017 .

[27]  C. Barry,et al.  Written spelling to dictation: Sound-to-spelling regularity affects both writing latencies and durations. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[28]  Marc Brysbaert,et al.  SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles , 2010, Behavior research methods.

[29]  Victoria Johansson,et al.  Reading during writing: Four different groups of writers , 2009 .

[30]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[31]  Victoria Johansson,et al.  Writing processes and text characteristics of texts produced in a triple-task situation. , 2014 .

[32]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[33]  Kate Wilmut,et al.  An examination of writing pauses in the handwriting of children with developmental coordination disorder. , 2014, Research in developmental disabilities.

[34]  Eric Van Horenbeeck,et al.  Analysing Keystroke Logging Data from a Linguistic Perspective , 2019, Observing Writing.

[35]  Åsa Wengelin,et al.  Reading during the composition of multi-sentence texts: an eye-movement study , 2016, Psychological research.

[36]  Florence Chenu,et al.  A Developmental Perspective on the Units of Written French , 2016 .

[37]  L. V. Waes,et al.  Reading during sentence composing and error correction: A multilevel analysis of the influences of task complexity , 2010 .

[38]  Emiel Krahmer,et al.  The online evaluation of speech synthesis using eye movements , 2007, SSW.

[39]  Åsa Wengelin,et al.  Keystroke logging in writing research : Analyzing online writing processes , 2015 .

[40]  Andy Field,et al.  Discovering statistics using SPSS, 2nd ed. , 2005 .

[41]  Denis Alamargot,et al.  Using eye and pen movements to trace the development of writing expertise: case studies of a 7th, 9th and 12th grader, graduate student, and professional writer , 2010 .

[42]  G. Nottbusch.  Grammatical planning, execution, and control in written sentence production , 2010 .

[43]  D. Sandra,et al.  Homophonic Forms of Regularly Inflected Verbs Have Their Own Orthographic Representations: A Developmental Perspective on Spelling Errors , 2002, Brain and Language.

[44]  Michael Carl,et al.  Towards a Classification of Translation Styles based on Eye-tracking and Keylogging Data , 2013 .

[45]  Dominiek Sandra,et al.  Why Simple Verb Forms Can Be So Difficult to Spell: The Influence of Homophone Frequency and Distance in Dutch , 1999, Brain and Language.

[46]  R. T. Kellogg.  Attentional overload and writing performance: effects of rough draft and outline strategies , 1988 .

[47]  Jodi C Sita,et al.  Eye movements during the handwriting of words: Individually and within sentences. , 2015, Human movement science.

[48]  K. Rayner,et al.  Eye movements in reading words and sentences , 2007 .

[49]  H. Bergh,et al.  Examples of Mixed-Effects Modeling with Crossed Random Effects and with Binomial Data. , 2008 .

[50]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[51]  S. De Maeyer,et al.  Coordinating sentence composition with error correction: A multilevel analysis , 2011 .

[52]  Victoria Johansson,et al.  Combined eyetracking and keystroke-logging methods for studying cognitive processes in text production , 2009, Behavior research methods.

[53]  Jan R. Magnus,et al.  The reliability of user authentication through keystroke dynamics , 2009 .

[54]  Sebastian Wallot,et al.  Typewriting Dynamics: What Distinguishes Simple From Complex Writing Tasks? , 2013 .

[55]  Haidee Kruger,et al.  What’s happening when nothing’s happening? Combining eyetracking and keylogging to explore cognitive processing during pauses in translation production , 2016 .

[56]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[57]  Victoria Johansson,et al.  What Keystroke Logging can Reveal about Writing , 2006, Computer Key-Stroke Logging and Writing.

[58]  Åsa Wengelin,et al.  Examining Pauses in Writing: Theory, Methods and Empirical Data , 2006, Computer Key-Stroke Logging and Writing.

[59]  Jan Engberg,et al.  The translator as a writer: Measuring the effect of writing skills on the translation product , 2014 .

[60]  Luuk Van Waes,et al.  Writing in the workplace: Constructing documents using multiple digital sources , 2014 .

[61]  J. Hayes.  A new framework for understanding cognition and affect in writing. , 1996 .

[62]  M. Fayol,et al.  Is graphic activity cognitively costly? A developmental approach , 2000 .

[63]  K. Rayner,et al.  Parafoveal word processing during eye fixations in reading: Effects of word frequency , 1986, Perception & psychophysics.

[64]  Matt C. Keener,et al.  Writing is Applied Metacognition , 2009 .

[65]  Christine Ros,et al.  Eye and Pen: A new device for studying reading during writing , 2006, Behavior research methods.

[66]  Åsa Wengelin,et al.  Studying reading during writing: new perspectives in research , 2010 .

[67]  Thierry Olive,et al.  Why are some texts good and others not? Relationship between text quality and management of the writing processes , 2011 .

[68]  Bernard Lété,et al.  Tracking the mind during writing: immediacy, delayed, and anticipatory effects on pauses and writing rate , 2011, Reading and Writing.