Keystroke Logging in Writing Research

Keystroke logging has become instrumental in identifying writing strategies and understanding cognitive processes. Recent technological advances have refined logging efficiency and analytical outputs. While keystroke logging allows for ecological data collection, it is often difficult to connect the fine grain of logging data to the underlying cognitive processes. Multiple methodologies are useful to offset these difficulties. In this article we explore the complementarity of the keystroke logging program Inputlog with other observational techniques: thinking aloud protocols and eyetracking data. In addition, we illustrate new graphic and statistical data analysis techniques, mainly adapted from network analysis and data mining. Data extracts are drawn from a study of writing from multiple sources. In conclusion, we consider future developments for keystroke logging, in particular letter- to word-level aggregation and logging standardization.

[1]  Sven Strömqvist,et al.  Influence of Typing Skill on Pause-Execution Cycles in Written Composition , 2007 .

[2]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[3]  Veerle M. Baaijen,et al.  Keystroke Analysis , 2012 .

[4]  Eva Lindgren,et al.  Computer keystroke logging and writing: methods and applications , 2006 .

[5]  Victoria Johansson,et al.  Combined eyetracking and keystroke-logging methods for studying cognitive processes in text production , 2009, Behavior research methods.

[6]  Jan R. Magnus,et al.  The reliability of user authentication through keystroke dynamics , 2009 .

[7]  Boudewijn F. van Dongen,et al.  The ProM Framework: A New Era in Process Mining Tool Support , 2005, ICATPN.

[8]  Victoria Johansson,et al.  Looking at the keyboard or the monitor: relationship with text production processes , 2010 .

[9]  Jan Vanthienen,et al.  50 years of data mining and OR: upcoming trends and challenges , 2009, J. Oper. Res. Soc..

[10]  Jason Swarts,et al.  Recycled Writing: Assembling Actor Networks From Reusable Content , 2010 .

[11]  Kerstin Severinson Eklundh.  Linear and Nonlinear Strategies in Computer-Based Writing. , 1994 .

[12]  Martin Nystrand,et al.  What writers know : the language, process, and structure of written discourse , 1982 .

[13]  Frank E. Ritter,et al.  A Design, Tests and Considerations for Improving Keystroke and Mouse Loggers , 2013, Interact. Comput..

[14]  William Hart-Davidson,et al.  Content Management in the Workplace , 2011 .

[15]  Luuk Van Waes,et al.  Logging writing processes with Inputlog , 2006 .

[16]  Peter Smagorinsky,et al.  The Reliability and Validity of Protocol Analysis , 1989 .

[17]  Kerstin Severinson Eklundh,et al.  Emerging discourse structure : computer-assisted episode analysis as a window to global revision in university students' writing , 2003 .

[18]  R. Abbott,et al.  Assessment of planning, translating, and revising in junior high writers , 1996 .

[19]  Hans P. Krings,et al.  Repairing Texts: Empirical Investigations of Machine Translation Post-Editing Processes , 2001 .

[20]  Jonathan B Freeman,et al.  MouseTracker: Software for studying real-time mental processing using a computer mouse-tracking method , 2010, Behavior research methods.

[21]  Sarah W. Beck,et al.  An investigation of academic writing in secondary schools to inform the development of diagnostic classroom assessments , 2011 .

[22]  Victoria Johansson,et al.  Combining Keystroke Logging with Eye Tracking , 2006 .

[23]  Huub van den Bergh,et al.  Effects of thinking aloud on writing processes , 1996 .

[24]  Luuk Van Waes,et al.  Inputlog: New Perspectives on the Logging of On-Line Writing Processes in a Windows Environment , 2006, Computer Key-Stroke Logging and Writing.

[25]  U. Will,et al.  Syllabic structures in typing : Evidence from hearing-impaired writers , 2003 .

[26]  Virginia W. Berninger,et al.  The writing brain , 2012 .

[27]  K. A. Ericsson,et al.  Protocol analysis: Verbal reports as data, Rev. ed. , 1993 .

[28]  Mariëlle Leijten,et al.  Writing and Speech Recognition : Observing Error Correction Strategies of Professional Writers , 2007 .

[29]  Eva Lindgren,et al.  Development of fluency and revision in L1 and L2 writing in Swedish High School years eight and nine , 2008 .

[30]  J. Hayes.  Modeling and Remodeling Writing , 2012 .

[31]  K. Rayner.  The perceptual span and peripheral cues in reading , 1975, Cognitive Psychology.

[32]  Christine M. Neuwirth,et al.  Writing and digital media , 2006 .

[33]  Muhammad M. Abdel Latif,et al.  A State-of-the-Art Review of the Real-Time Computer-Aided Study of the Writing Process , 2008 .

[34]  Carmen Heine,et al.  Process Research Methods and Their Application in the Didactics of Text Production and Translation Shedding Light on the Use of Research Methods in the University Classroom , 2009 .

[35]  Åsa Wengelin,et al.  Logging tools to study digital writing processes , 2011 .

[36]  Jukka Hyönä,et al.  Effects of Topic Headings on Text Processing: Evidence from Adult Readers' Eye Fixation Patterns. , 2004 .

[37]  Mariëlle Leijten,et al.  Error correction strategies of professional speech recognition users: Three profiles , 2010, Comput. Hum. Behav..

[38]  L. V. Waes,et al.  Writing profiles : the effect of the writing mode on pausing and revision patterns of experienced writers , 2003 .

[39]  J. Hayes,et al.  Fluency in Writing , 2001 .

[40]  L. V. Waes,et al.  Reading during sentence composing and error correction: A multilevel analysis of the influences of task complexity , 2010 .

[41]  Rui A. Alves.  The future is bright for writing research , 2012 .

[42]  Kirk P. H. Sullivan,et al.  Keystroke logging : an introduction , 2006 .

[43]  Virginia W. Berninger,et al.  Development of Language by Hand and Its Connections with Language by Ear, Mouth, and Eye , 2000 .

[44]  Py Kollberg.  S-notation - a computer based method for studying and representing text composition , 1998 .

[45]  John Scott.  Social Network Analysis , 1988 .

[46]  K. Spelman-Miller.  Pausing, Productivity and the Processing of Topic in OnLine Writing , 2006, Computer Key-Stroke Logging and Writing.

[47]  Christine Ros,et al.  Eye and Pen: A new device for studying reading during writing , 2006, Behavior research methods.

[48]  Åsa Wengelin,et al.  Studying reading during writing: new perspectives in research , 2010 .

[49]  Mark C. Fox,et al.  Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. , 2011, Psychological bulletin.

[50]  Kristyan Spelman Miller.  Academic writers on-line: investigating pausing in the production of text , 2000 .

[51]  D. van Weijen,et al.  Writing processes, text quality, and task effects; empirical studies in first and second language writing , 2009 .

[52]  Eva Lindgren,et al.  Stimulated Recall as a Trigger for Increasing Noticing and Language Awareness in the L2 Writing Classroom: A Case Study of Two Young Female Writers , 2003 .

[53]  Veronique Hoste,et al.  From Character to Word Level: Enabling the Linguistic Analyses of Inputlog Process Data , 2012, DocEng 2012.

[54]  Urmila Kukreja,et al.  RUI: Recording user input from interfaces under Windows and Mac OS X , 2006, Behavior research methods.

[55]  N. Ann Chenoweth,et al.  Is Working Memory Involved in the Transcribing and Editing of Texts? , 2006 .

[56]  Udo Will,et al.  Syllabic Sructures in Typing: Evidence from Deaf Writers , 2005 .

[57]  Victoria Johansson,et al.  What Keystroke Logging can Reveal about Writing , 2006, Computer Key-Stroke Logging and Writing.

[58]  Karen R. Harris,et al.  The role of strategies, knowledge, will, and skills in a 30-year program of writing research (with Homage to Hayes, Fayol, and Boscolo) , 2012 .

[59]  Thierry Olive,et al.  Why are some texts good and others not? Relationship between text quality and management of the writing processes , 2011 .

[60]  Mariëlle Leijten,et al.  Correcting Text Production Errors: Isolating the Effects of Writing Mode From Error Span, Input Mode, and Lexicality , 2010 .

[61]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[62]  Åsa Wengelin,et al.  Examining Pauses in Writing: Theory, Methods and Empirical Data , 2006, Computer Key-Stroke Logging and Writing.

[63]  Virginia W. Berninger,et al.  Past, Present, and Future Contributions of Cognitive Writing Research to Cognitive Psychology , 2012 .

[64]  Jochen De Weerdt,et al.  Process discovery in event logs: An application in the telecom industry , 2011, Appl. Soft Comput..