Assessment of Learners' Attention to E-Learning by Monitoring Facial Expressions for Computer Network Courses

Recognition of students' facial expressions can be used to understand their level of attention. In a traditional classroom setting, teachers guide the classes and continuously monitor and engage the students to evaluate their understanding and progress. Given the current popularity of e-learning environments, it has become important to assess the degree of attention during the online learning process. In this study, we used interactive video-capture facial-recognition technology to automatically detect the facial expressions of students as a means of analyzing their attention state during the e-learning process. Participants were divided into three different learning-strategy groups for a course on computer networks. An attention-detection feedback module evaluated participants' attention span during the learning sessions and initiated a response to redirect the participants' attention when they became distracted. The three groups of participants showed significant differences in their course achievement; this was attributed to the different learning strategies used for content presentation. A positive correlation was found between learning improvement and attention, indicating that video-capture facial-recognition technology can be used to provide timely learning assistance and appropriate stimulation to enhance the educational benefits of e-learning.

[1]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[2]  A. Kennedy,et al.  Theoretical perspectives on eye movements in reading: Past controversies, current issues, and an agenda for future research , 2004 .

[3]  Kai-Kuang Ma,et al.  A switching median filter with boundary discriminative noise detection for extremely corrupted images , 2006, IEEE Trans. Image Process..

[4]  Stephen J. Boies,et al.  Components of attention. , 1971 .

[5]  Paolo Bianchetti,et al.  Master students tell their story , 2005 .

[6]  Andrew T. Duchowski,et al.  Eye tracking methodology - theory and practice, 2nd Edition , 2007 .

[7]  Michael I. Posner,et al.  Computerized games to study the development of attention in childhood , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[8]  Rosalind W. Picard,et al.  Affective-Cognitive Learning and Decision Making: A Motivational Reward Framework for Affective Agents , 2005, ACII.

[9]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[10]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[11]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[12]  J. Colombo The development of visual attention in infancy. , 2001, Annual review of psychology.

[13]  Rama Chellappa,et al.  Background learning for robust face recognition with PCA in the presence of clutter , 2005, IEEE Transactions on Image Processing.

[14]  Michael G. Strintzis,et al.  Face localization and authentication using color and depth images , 2005, IEEE Transactions on Image Processing.

[15]  Katharina Scheiter,et al.  Attention guidance during example study via the model's eye movements , 2009, Comput. Hum. Behav..

[16]  M. Coltheart Attention and Performance XII: The Psychology of Reading , 1987 .

[17]  J. Stanley,et al.  Book Review: Taxonomy of Educational Objectives, The Classification of Educational Goals, Handbook I: Cognitive Domain , 1957 .

[18]  G. Lyon,et al.  Attention, Memory, and Executive Function , 1995 .

[19]  R. L. Ebel,et al.  Essentials of educational measurement , 1972 .

[20]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[21]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[22]  J. Kruschke Attention in Learning , 2003 .

[23]  Erik D. Reichle,et al.  Eye Movement Control during Reading: Effects of Word Frequency and Orthographic Familiarity Word Frequency Effects , 2022 .

[24]  Rik Pieters,et al.  The Effect of Time Pressure and Task Motivation on Visual Attention to Brands , 1997 .

[25]  Fitria Amastini,et al.  Intelligent Tutoring System , 2014 .

[26]  林宜親 Yi-Chin Lin,et al.  以認知神經科學取向探討兒童注意力的發展和學習之關聯 The relationship between development of attention and learning in children A cognitive neuroscience approach , 2011 .

[27]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2002, IS&T/SPIE Electronic Imaging.

[28]  George W. McConkie,et al.  Reading Chinese: Some basic eye-movement characteristics. , 1999 .

[29]  N. Kanwisher,et al.  The Human Body , 2001 .

[30]  Bruce D. McCandliss,et al.  Testing the Efficiency and Independence of Attentional Networks , 2002, Journal of Cognitive Neuroscience.

[31]  Chung-Lin Huang,et al.  Human Face Recognition from A Single Front View , 1992, Int. J. Pattern Recognit. Artif. Intell..

[32]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[33]  Thomas S. Tullis,et al.  Efficiency, Trust, and Visual Appeal: Usability Testing through Eye Tracking , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[34]  Brooke Broadbent,et al.  ABCs of e-Learning: Reaping the Benefits and Avoiding the Pitfalls , 2002 .

[35]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[36]  陳年興 Nian-Shing Chen 網路教學的課程設計與班級經營 | The Curriculum Design and Classroom Management of E-Learning , 2003 .

[37]  Tadahiro Kuroda,et al.  A real-time multi face detection technique using positive-negative lines-of-face template , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[38]  Hong-Ren Chen,et al.  User Acceptance of Mobile Knowledge Management Learning System: Design and Analysis , 2010, J. Educ. Technol. Soc..

[39]  Kurt Gramoll,et al.  Web-based Distance Learning Environment Using a Database to Teach Educators about Electronic Media , 2001 .

[40]  G. Rizzolatti,et al.  Spatial attention and eye movements , 2004, Experimental Brain Research.

[41]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  J. Yager,et al.  Stroke in Children and Young Adults , 1995 .