Eye and Pen: A new device for studying reading during writing

We present a new method for studying reading during writing and the relationships between these two activities. The Eye and Pen device makes a synchronous recording of handwriting and eye movements during written composition. It complements existing online methods by providing a fine-grained description of the visual information fixated during pauses as well as during the actual writing act. This device can contribute to the exploration of several research issues, since it can be used to investigate the role of the text produced so far and the documentary sources displayed in the task environment. The study of the engagement of reading during writing should provide important information about the dynamics of writing processes based on visual information.

[1]  Douglas J. Hacker,et al.  Environmental, cognitive, and metacognitive influences on text revision: Assessing the evidence , 1996 .

[2]  Sarah Ellen Ransdell,et al.  Working memory constraints on writing quality and fluency. , 2013 .

[3]  M. Kennedy.  The Composing Process of College Students Writing from Sources , 1985 .

[4]  Linda Flower,et al.  The Dynamics of Composing : Making Plans and Juggling Constraints , 1980 .

[5]  G. Schumacher.  Cognitive Activities of Beginning and Advanced College Writers: A Pausal Analysis. , 1984 .

[6]  Denis Alamargot,et al.  Through the Models of Writing , 2001 .

[7]  Zenzi M. Griffin,et al.  PSYCHOLOGICAL SCIENCE Research Article WHAT THE EYES SAY ABOUT SPEAKING , 2022 .

[8]  Ron Oostdam,et al.  Improving Linguistic Fluency for Writing: Effects of Explicitness and Focus of Instruction , 2002 .

[9]  C. Lee,et al.  Eye and head coordination in reading: roles of head movement and cognitive control , 1999, Vision Research.

[10]  R. T. Kellogg.  Attentional overload and writing performance: effects of rough draft and outline strategies , 1988 .

[11]  W. Mcginley.  The Role of Reading and Writing while Composing from Sources. , 1992 .

[12]  Thierry Baccino,et al.  Spatial Encoding and Referential Processing during Reading , 1998 .

[13]  J. Hayes.  A new framework for understanding cognition and affect in writing. , 1996 .

[14]  Michel Hupet,et al.  The acquisition of subject-verb agreement in written French: From novices to experts' errors , 1999 .

[15]  William L. Smith,et al.  Interrupting Visual Feedback in Writing , 1983, Perceptual and motor skills.

[16]  L. Chanquoy,et al.  Temporal management of short text writing by children and adults , 1990 .

[17]  R. T. Kellogg,et al.  Concurrent activation of high- and low-level production processes in written composition , 2002, Memory & cognition.

[18]  R. T. Kellogg.  Effects of topic knowledge on the allocation of processing time and cognitive effort to writing processes , 1987, Memory & cognition.

[19]  R. T. Kellogg.  A model of working memory in writing. , 1996 .

[20]  Sarah Ellen Ransdell,et al.  Using a real-time replay of students’ word processing to understand and promote better writing , 1990 .

[21]  J. Hayes,et al.  On the nature of planning in writing. , 1996 .

[22]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[23]  Sarah Ellen Ransdell,et al.  Bilingual long-term working memory: The effects of working memory loads on writing quality and fluency , 2001, Applied Psycholinguistics.

[24]  W. Levelt,et al.  Viewing and naming objects: eye movements during noun phrase production , 1998, Cognition.

[25]  Annie Piolat,et al.  Comment étudier le coût et le déroulement de la rédaction de textes ? La méthode de la triple tâche : un bilan méthodologique , 2000 .

[26]  S. Graham,et al.  A review of handwriting research: Progress and prospects from 1980 to 1994 , 1996 .

[27]  C. Michael Levy,et al.  The Science of Writing : Theories, Methods, Individual Differences and Applications , 1996 .

[28]  A. Gordon,et al.  Eye Movements and Eye-Hand Coordination During Typing , 1997 .

[29]  Gary M. Schumacher,et al.  Writing from Sources: A Structure-Mapping Model. , 1993 .

[30]  M. Daneman,et al.  Individual differences in comprehending and producing words in context , 1986 .

[31]  C. Michael Levy,et al.  Computer-aided protocol analysis of writing processes , 1994 .

[32]  Gregg T. Vesonder,et al.  Text generation and recall by high-knowledge and low-knowledge individuals , 1980 .

[33]  Joost Schilperoord,et al.  It's about time: Temporal aspects of cognitive processes in text production , 1996 .

[34]  Geoffrey Sirc,et al.  A computer toll for analyzing the composing process , 1988 .

[35]  M. Smyth,et al.  Functions of vision in the control of handwriting , 1987 .

[36]  John R. Anderson.  Spanning seven orders of magnitude: a challenge for cognitive modeling , 2002 .

[37]  Deborah McCutchen,et al.  Revising for Meaning: Effects of Knowledge and Strategy. , 1997 .

[38]  Hayes.  identifying the organization of wi iiing processes , 1980 .

[39]  Patrick Lemaire,et al.  Cognitive Overload and Orthographic Errors: When Cognitive Overload Enhances Subject–Verb Agreement Errors. A Study in French Written Language , 1994 .

[40]  Mark Torrance,et al.  Finding something to write about: strategic and automatic processes in idea generation , 1996 .

[41]  Jean-Noël Foulin.  Pauses et débits : les indicateurs temporels de la production écrite , 1995 .

[42]  Daniel C. Richardson,et al.  Eye Tracking: Characteristics And Methods , 2004 .

[43]  G. Wnek,et al.  Encyclopedia of biomaterials and biomedical engineering , 2008 .

[44]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[45]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[46]  Michel Fayol,et al.  Processing interclausal relationships : studies in the production and comprehension of text , 1997 .

[47]  Michael F. Graves,et al.  Intensive Vocabulary Instruction as a Prewriting Technique. , 1987 .

[48]  D. Chesnet,et al.  G-STUDIO : un logiciel pour l'étude en temps réel des paramètres temporels de la production écrite , 1994 .

[49]  Denis Alamargot,et al.  Chapter 2: Parallel Processing Before and After Pauses: A Combined Analysis of Graphomotor and Eye Movements During Procedural Text Production , 2007 .

[50]  M. Fayol,et al.  Even in adults, written production is still more costly than oral production , 2002 .

[51]  Helen Arvidson,et al.  Augmentative and Alternative Communication: New Directions in Research and Practice , 1999 .

[52]  Gert Rijlaarsdam,et al.  Chapter 9: The Dynamics of Idea Generation During Writing: An Online Study , 2007 .

[53]  Kenton O'Hara,et al.  Understanding the materiality of writing from multiple sources , 2002, Int. J. Hum. Comput. Stud..

[54]  Huub van den Bergh,et al.  Effects of thinking aloud on writing processes , 1996 .

[55]  H. Ehrlichman,et al.  Lateral eye movements and hemispheric asymmetry: a critical review. , 1978, Psychological bulletin.

[56]  Denis Alamargot,et al.  Mémoire de travail et rédaction de textes: évolution des modèles et bilan des premiers travaux , 2002 .

[57]  R. Steinman,et al.  Temporal coordination of the human head and eye during a natural sequential tapping task , 2001, Vision Research.

[58]  A. Glenberg,et al.  Averting the gaze disengages the environment and facilitates remembering , 1998, Memory & cognition.

[59]  D. McCutchen.  A capacity theory of writing: Working memory in composition , 1996 .

[60]  D. Chesnet,et al.  Analyse en temps réel des activités oculaires et grapho-motrices du scripteur: intérêt du dispositif « Eye and Pen » , 2005 .

[61]  Denis Alamargot,et al.  ACCESSING REFERENTIAL INFORMATION DURING TEXT COMPOSITION :WHEN AND WHY ? , 1999 .

[62]  An application of multilevel analysis on writing process data , 1996 .

[63]  Daniel C. Richardson,et al.  Eye Tracking: Characteristics And Methods , 2004 .

[64]  Gilles Caporossi,et al.  Using the Computer to Study the Dynamics of the Handwriting Processes , 2004, Discovery Science.

[65]  R. Miall,et al.  A Painter's Eye Movements: A Study of Eye and Hand Movement during Portrait Drawing , 2001, Leonardo.

[66]  Annie Piolat,et al.  Suppressing visual feedback in written composition: Effects on processing demands and coordination of the writing processes , 2002 .

[67]  Martial Van der Linden.  Pauses et débits: les indicateurs temporels de la production écrite , 1995 .

[68]  Virginia W. Berninger,et al.  Coordinating Transcription and Text Generation in Working Memory during Composing: Automatic and Constructive Processes , 1999 .

[69]  Mark Torrance,et al.  Knowing what to write : conceptual processes in text production , 1999 .

[70]  Automatisme en détection d'erreurs d'accord sujet-verbe: étude chez l'enfant et l'adulte , 2002 .

[71]  Joël Pynte,et al.  Reading as a Perceptual Process , 2000 .

[72]  D. Kaufer.  Composing Written Sentences. , 1986 .