Investigating Differences in Gaze and Typing Behavior Across Writing Genres

ABSTRACT Writing is one of the most common activities undertaken on a computer, and the activity of writing has been widely studied. Given that writing is an intensively cognitive process, it makes sense that the type of writing that is being produced would have an effect on the writer’s gaze and typing behaviors. However, only a few studies have explored this relationship. In this paper, we study the gaze-typing behaviors, specifically, the coordination between eye gaze and typing dynamics, of writers who are producing original articles in different genres: reminiscent, logical and creative. Our study focuses on Chinese typing, particularly via the Pinyin input method, which generates text via a two step method, and requires additional cognitive processes compared to typing in phonographic languages such as English. Our study involves 46 native Chinese speakers of varying ages from children to elderly. Our method deploys statistics- and sequence-based features to infer the mental state of the author during the writing process. The statistics-based features focus on modeling the overall gaze-typing behaviors during the process and the sequence-based features focus on the transition of the gaze-typing behaviors as the piece of writing progresses. Using a linear support-vector machine, we achieve an overall accuracy over 88% for the article-genre detection by using a leave-one-subject-out cross-validation evaluation.

[1]  N. Nachar.  The Mann ‐ Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution , 2007 .

[2]  Zhiyuan Liu,et al.  Why Press Backspace? Understanding User Input Behaviors in Chinese Pinyin Input Method , 2011, ACL.

[3]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[4]  George L. Malcolm,et al.  Eye Movements and Visual Encoding During Scene Perception , 2009, Psychological science.

[5]  Soumik Mondal.  Continuous Authentication with Keystroke Dynamics , 2015 .

[6]  Haruhiko Nishimura,et al.  Keystroke timing analysis for individual identification in Japanese free text typing , 2009, 2009 ICCAS-SICE.

[7]  Christine Ros,et al.  Eye and Pen: A new device for studying reading during writing , 2006, Behavior research methods.

[8]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[9]  Kerry Rodden,et al.  Eye-mouse coordination patterns on web search results pages , 2008, CHI Extended Abstracts.

[10]  Gordon D. Logan,et al.  Time, Information, and the Various Spans in Typewriting , 1983 .

[11]  L. V. Waes,et al.  Reading during sentence composing and error correction: A multilevel analysis of the influences of task complexity , 2010 .

[12]  Åsa Wengelin,et al.  Reading during the composition of multi-sentence texts: an eye-movement study , 2016, Psychological research.

[13]  Thomas Beauvisage,et al.  Computer usage in daily life , 2009, CHI.

[14]  I. Traoré.  Continuous Authentication , 2021, Encyclopedia of Cryptography, Security and Privacy.

[15]  Anirudha Joshi,et al.  Keylekh: a keyboard for text entry in indic scripts , 2004, CHI EA '04.

[16]  Jun Wang,et al.  Detecting stress from mouse-gaze attraction , 2019, SAC.

[17]  Laura K. Allen,et al.  Keystroke Dynamics Predict Essay Quality , 2017, CogSci.

[18]  Victoria Johansson,et al.  Looking at the keyboard or the monitor: relationship with text production processes , 2010 .

[19]  Alexis Dinno,et al.  Nonparametric Pairwise Multiple Comparisons in Independent Groups using Dunn's Test , 2015 .

[20]  R. L. C. Butsch.  Eye movements and the eye-hand span in typewriting. , 1932 .

[21]  KongFatt Wong-Lin,et al.  A novel multimodal gaze-controlled Hindi virtual keyboard for disabled users , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Antti Oulasvirta,et al.  How We Type: Movement Strategies and Performance in Everyday Typing , 2016, CHI.

[23]  Ryen W. White,et al.  User see, user point: gaze and cursor alignment in web search , 2012, CHI.

[24]  Vir V. Phoha,et al.  Continuous authentication with cognition-centric text production and revision features , 2014, IEEE International Joint Conference on Biometrics.

[25]  Sebastian Wallot,et al.  Typewriting Dynamics: What Distinguishes Simple From Complex Writing Tasks? , 2013 .

[26]  Perry D. Klein.  Reopening Inquiry into Cognitive Processes in Writing-To-Learn , 1999 .

[27]  Hong Va Leong,et al.  StressClick: Sensing Stress from Gaze-Click Patterns , 2016, ACM Multimedia.

[28]  James Tompkin,et al.  The eye of the typer: a benchmark and analysis of gaze behavior during typing , 2018, ETRA.

[29]  Chew Lim Tan,et al.  Proposing a New Term Weighting Scheme for Text Categorization , 2006, AAAI.

[30]  John M. Henderson,et al.  Neural correlates of fixation duration in natural reading: Evidence from fixation-related fMRI , 2015, NeuroImage.

[31]  Evgeny Chukharev-Khudilaynen,et al.  Pauses in spontaneous written communication: A keystroke logging study , 2014 .

[32]  Juan Enrique Ramos,et al.  Using TF-IDF to Determine Word Relevance in Document Queries , 2003 .

[33]  Harold D. Delaney,et al.  The Kruskal-Wallis Test and Stochastic Homogeneity , 1998 .

[34]  A. Gordon,et al.  Eye Movements and Eye-Hand Coordination During Typing , 1997 .

[35]  J. Hayes,et al.  A Cognitive Process Theory of Writing , 1981, College Composition & Communication.

[36]  Heinrich H. Bülthoff,et al.  Eye and pointer coordination in search and selection tasks , 2010, ETRA.

[37]  H. Schiffman.  Sensation and Perception: An Integrated Approach , 1976 .

[38]  Saeid Nahavandi,et al.  Bag-of-words representation for biomedical time series classification , 2012, Biomed. Signal Process. Control..

[39]  Mary Czerwinski,et al.  Under pressure: sensing stress of computer users , 2014, CHI.

[40]  Rajesh Kumar,et al.  Continuous authentication of smartphone users by fusing typing, swiping, and phone movement patterns , 2016, 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[41]  Fabrizio Sebastiani,et al.  Supervised term weighting for automated text categorization , 2003, SAC '03.