Toward Fully Automated Person-Independent Detection of Mind Wandering

Mind wandering is a ubiquitous phenomenon where attention involuntary shifts from task-related processing to task-unrelated thoughts. Mind wandering has negative effects on performance, hence, intelligent interfaces that detect mind wandering can intervene to restore attention to the current task. We investigated the use of eye gaze and contextual cues to automatically detect mind wandering during reading with a computer interface. Participants were pseudo-randomly probed to report mind wandering instances while an eye tracker recorded their gaze during a computerized reading task. Supervised machine learning techniques detected positive responses to mind wandering probes from gaze and context features in a user-independent fashion. Mind wandering was predicted with an accuracy of 72% (expected accuracy by chance was 62%) when probed at the end of a page and an accuracy of 59% (chance was 50%) when probed in the midst of reading a page. Possible improvements to the detectors and applications are discussed.

[1]  Andreas Dengel,et al.  A robust realtime reading-skimming classifier , 2012, ETRA.

[2]  Erik D. Reichle,et al.  Meta-awareness, perceptual decoupling and the wandering mind , 2011, Trends in Cognitive Sciences.

[3]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[4]  Jonathan S. A. Carriere,et al.  Out of Mind, Out of Sight , 2010, Psychological science.

[5]  John Seely Brown,et al.  Intelligent Tutoring Systems , 2016, Lecture Notes in Computer Science.

[6]  Takashi Matsuyama,et al.  Multi-mode saliency dynamics model for analyzing gaze and attention , 2012, ETRA.

[7]  Benjamin W. Mooneyham,et al.  The costs and benefits of mind-wandering: a review. , 2013, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[8]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[9]  Cristina Conati,et al.  An Analysis of Attention to Student - Adaptive Hints in an Educational Game , 2012, ITS.

[10]  Sidney K. D'Mello,et al.  Automatic Gaze-Based Detection of Mind Wandering during Reading , 2013, EDM.

[11]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[12]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[13]  Erik D. Reichle,et al.  Eye Movements During Mindless Reading , 2010, Psychological science.

[14]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[15]  Joanna Drummond,et al.  In the Zone: Towards Detecting Student Zoning Out Using Supervised Machine Learning , 2010, Intelligent Tutoring Systems.

[16]  H. Ellis,et al.  Irrelevant thoughts, emotional mood states, and cognitive task performance , 1991, Memory & cognition.

[17]  Jonathan Smallwood,et al.  Subjective experience and the attentional lapse: Task engagement and disengagement during sustained attention , 2004, Consciousness and Cognition.

[18]  J. Smallwood,et al.  When attention matters: The curious incident of the wandering mind , 2008, Memory & cognition.

[19]  Arthur C. Graesser,et al.  Mind wandering while reading easy and difficult texts , 2013, Psychonomic bulletin & review.

[20]  Oleg V. Komogortsev,et al.  Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network , 2010, CHI Extended Abstracts.

[21]  Erik D. Reichle,et al.  Zoning Out while Reading: Evidence for Dissociations between Experience and Metaconsciousness. , 2004 .

[22]  Roman Bednarik,et al.  What do you want to do next: a novel approach for intent prediction in gaze-based interaction , 2012, ETRA.

[23]  D. Gilbert,et al.  A Wandering Mind Is an Unhappy Mind , 2010, Science.

[24]  Tal Oron-Gilad,et al.  'Castling rays' a decision support tool for UAV-switching tasks , 2010, CHI Extended Abstracts.

[25]  Arthur M. Jacobs,et al.  OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs , 2008, Behavior research methods.

[26]  Ravi Kumar,et al.  Attention and selection in online choice tasks , 2012, UMAP.

[27]  Pernilla Qvarfordt,et al.  Proceedings of the Symposium on Eye Tracking Research and Applications , 2012 .

[28]  Francesco Ricci,et al.  User Modeling, Adaptation, and Personalization , 2014, Lecture Notes in Computer Science.

[29]  Rafael A. Calvo,et al.  Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications , 2010, IEEE Transactions on Affective Computing.