Attention Decrease Detection Based on Video Analysis in E-Learning

E-learning takes the advantages of lower cost and higher benefit. It becomes one of the educational research focus through learning behavior analysis to promote deep learning. In order to help learners overcome possible disadvantages in e-learning environment such as prone inattention and delayed response, one video analysis algorithm is designed to detect attention decrease situation, then feedback in time or warn early. The algorithm uses head posture, gaze, eye closure and mouth opening, facial expression features as attention observation attributes. Next machine learning classifiers are applied to code behavior features. Finally the time sequential statistics of behavior features evaluate the attention level and emotional pleasure degree. Experiments show that the algorithm is effective to find out the inattention cases to give desirable feedback. It may be applicable in adaptive learning and human computer interaction fields.

[1]  Xuan Zhang,et al.  Comments on the Development of MOOCs and the Design of Core Supporting Policy in China , 2016, 2016 International Conference on Educational Innovation through Technology (EITT).

[2]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[3]  Duan Fu Research on learning states based on facial features , 2013 .

[4]  Rosalind W. Picard Affective Computing , 1997 .

[5]  Yuen-Hsien Tseng,et al.  Tracking learners' visual attention during a multimedia presentation in a real classroom , 2013, Comput. Educ..

[6]  Peter Robinson,et al.  Cross-dataset learning and person-specific normalisation for automatic Action Unit detection , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[7]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[8]  Kostas Karpouzis,et al.  Estimation of behavioral user state based on eye gaze and head pose—application in an e-learning environment , 2009, Multimedia Tools and Applications.

[9]  Peter Robinson,et al.  Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[10]  Peter Robinson,et al.  Rendering of Eyes for Eye-Shape Registration and Gaze Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).