Classifying Emotion based on Facial Expression Analysis using Gabor Filter: A Basis for Adaptive Effective Teaching Strategy

Emotion is equivalent to mood or state of human emotion that correlates with non-verbal behavior. Related literature shows that humans tend to give off a clue for a particular feeling through nonverbal cues such as facial expression. This study aims to analyze the emotion of students using Philippines-based corpus of a facial expression such as fear, disgust, surprised, sad, anger and neutral with 611 examples validated by psychology experts and results aggregates the final emotion, and it will be used to define the meaning of emotion and connect it with a teaching pedagogy to support decisions on teaching strategies. The experiments used feature extraction methods such as Haar-Cascade classifier for face detection; Gabor filter and eigenfaces API for features extraction; and support vector machine in training the model with 80.11% accuracy. The result was analyzed and correlated with the appropriate teaching pedagogies for educators and suggest that relevant interventions can be predicted based on emotions observed in a lecture setting or a class. Implementing the prototype in Java environment, it captured images in actual class to scale the actual performance rating and had an average accuracy of 60.83 %. It concludes that through aggregating the facial expressions of students in the class, an adaptive learning strategy can be developed and implemented in the classroom environment.

[1]  Bryan G. Dadiz,et al.  Skybiometry and AffectNet on Facial Emotion Recognition Using Supervised Machine Learning Algorithms , 2018, ICCCV '18.

[2]  Caroline F. Mansfield,et al.  Teacher Emotion Research: Introducing a Conceptual Model to Guide Future Research. , 2015 .

[3]  P. Kulinna,et al.  Social and Emotional Pedagogy: Rhythm and Junctures , 2011 .

[4]  Erik Cambria,et al.  Affective Computing and Sentiment Analysis , 2016, IEEE Intelligent Systems.

[5]  E. Frydenberg Beyond coping: Meeting goals, visions, and challenges. , 2002 .

[6]  Brad Shuck,et al.  Emotions and Their Effect on Adult Learning: A Constructivist Perspective , 2013 .

[7]  George Essel,et al.  Causes of students’ stress, its effects on their academic success, and stress management by students , 2017 .

[8]  Holly McCracken,et al.  Reflective Pedagogy: Making Meaning in Experiential Based Online Courses. , 2010 .

[9]  Inquiry-Based Learning in Teacher Education: A Primary Humanities Example. , 2015 .

[10]  Lucy Le Mare,et al.  Supporting teachers in relational pedagogy and social emotional education : a qualitative exploration , 2017 .

[11]  Rafael A. Calvo,et al.  Beyond the basic emotions: what should affective computing compute? , 2013, CHI Extended Abstracts.

[12]  Néstor Daniel Roselli,et al.  El aprendizaje colaborativo: Bases teóricas y estrategias aplicables en la enseñanza universitaria , 2016 .

[13]  Anna Liza A. Ramos,et al.  A Facial Expression Emotion Detection using Gabor Filter and Principal Component Analysis to identify Teaching Pedagogy , 2018, 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology,Communication and Control, Environment and Management (HNICEM).

[14]  Lawrence A. Beard,et al.  Using Constructivist Teaching Strategies to Enhance Academic Outcomes of Students with Special Needs. , 2016 .

[15]  Debra K. Meyer,et al.  Discovering Emotion in Classroom Motivation Research , 2002 .

[16]  Jongmoo Choi,et al.  A real-time face recognition system using multiple mean faces and dual mode Fisherfaces , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[17]  Anna Liza A. Ramos,et al.  Face Expression Extraction Using Eigenfaces, Fisherfaces and Local Binary Pattern Histogram Towards Predictive Analysis of Students Emotion in Programming , 2017, BDTA.

[18]  Sidney K. D'Mello,et al.  What Emotions Do Novices Experience during Their First Computer Programming Learning Session? , 2013, AIED.

[19]  Y. Kimura Expressing Emotions in Teaching : Inducement, Suppression, and Disclosure as Caring Profession , 2010 .

[20]  Himanshu Thapliyal,et al.  A Survey of Affective Computing for Stress Detection: Evaluating technologies in stress detection for better health , 2016, IEEE Consumer Electronics Magazine.

[21]  Chloë Brushwood Rose,et al.  The significance of emotions in teaching and learning: on making emotional significance , 2007 .

[22]  Peter Felten,et al.  Emotion and Learning: Feeling Our Way toward a New Theory of Reflection in Service-Learning. , 2006 .

[23]  J. Lerner,et al.  Emotion and decision making. , 2015, Annual review of psychology.

[24]  Javier Serrano-Puche,et al.  Emotions and Digital Technologies: Mapping the Field of Research in Media Studies , 2015 .

[25]  M. Winterbottom,et al.  The role of emotion in teaching: are there differences between male and female newly qualified teachers’ approaches to teaching? , 2009 .

[26]  Bryan G. Dadiz,et al.  Dimension Reduction Techniques Analysis on Image Processing for Facial Emotion Recognition , 2018, ICCCV '18.

[27]  Nate Mccaughtry The Emotional Dimensions of a Teacher’s Pedagogical Content Knowledge: Influences on Content, Curriculum, and Pedagogy , 2004 .