Towards the detection of learner's uncertainty through face

This research aims to detect uncertainty based on facial expression in a learning context with the use of the Facial Action Coding System (FACS). Although FACS has been used to categorize facial uncertainty, very few studies have worked in this field. Most studies rather focus on uncertainty detection using voice, even though uncertainty is more apparent through facial cues compared to vocal cues, and this warrants for the collection and analysis of a facial corpus. Hence, an effort to collect a facial corpus of uncertainty were made and the corpus is then analyzed. Data was collected through an experiment that entailed using stimuli to induce the uncertainty of the subject. The data was annotated in order to verify the images before proceeding to preprocessing and feature extraction techniques. The feature extraction of the images was carried out using Gabor Wavelets and classification to train the data is used Support Vector Machine (SVM).

[1]  P. Ekman,et al.  Measuring facial movement , 1976 .

[2]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[3]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[4]  Vinay Bettadapura,et al.  Face Expression Recognition and Analysis: The State of the Art , 2012, ArXiv.

[5]  Diane J. Litman,et al.  Responding to Student Uncertainty During Computer Tutoring: An Experimental Evaluation , 2008, Intelligent Tutoring Systems.

[6]  Syaheerah L. Lutfi,et al.  Identifying Significant Task-Based Predictors of Emotion in Learning , 2015, PRIMA Workshops.

[7]  Fernando Fernández Martínez,et al.  A satisfaction-based model for affect recognition from conversational features in spoken dialog systems , 2013, Speech Commun..

[8]  Paul E. Debevec,et al.  Exploring the effect of illumination on automatic expression recognition using the ICT-3DRFE database , 2012, Image Vis. Comput..

[9]  Diane J. Litman,et al.  Benefits and challenges of real-time uncertainty detection and adaptation in a spoken dialogue computer tutor , 2011, Speech Commun..

[10]  M. Iqbal Saripan,et al.  3D facial expression recognition using maximum relevance minimum redundancy geometrical features , 2012, EURASIP Journal on Advances in Signal Processing.

[11]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[12]  Kai-Tai Song,et al.  Facial expression recognition based on mixture of basic expressions and intensities , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[13]  Ramón López-Cózar,et al.  On the Use of Kappa Coefficients to Measure the Reliability of the Annotation of Non-acted Emotions , 2008, PIT.

[14]  Fadi Dornaika,et al.  Simultaneous Facial Action Tracking and Expression Recognition in the Presence of Head Motion , 2008, International Journal of Computer Vision.

[15]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Mu-Chun Su,et al.  A simple approach to facial expression recognition , 2007 .

[17]  Barbara Schuppler,et al.  Automatic detection of uncertainty in spontaneous German dialogue , 2015, INTERSPEECH.

[18]  Arvid Kappas,et al.  Angle of regard: The effect of vertical viewing angle on the perception of facial expressions , 1994 .

[19]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[20]  Nicu Sebe,et al.  Authentic Facial Expression Analysis , 2004, FGR.