A Step Towards Preschoolers' Satisfaction Assessment Support by Facial Expression Emotions Identification

Abstract Children of nowadays grow in a digital landscape, so education has embraced the advantages brought by the multimedia technology progress. Appropriate interactive learning experiences positively influence learners’ performance. However, new challenges occur when the learners are preschoolers, as they are not able to articulate and communicate their experience towards interaction with edutainment applications. In this paper we explore the appropriateness of using Machine Learning-techniques in identifying preschoolers’ emotions while interacting with edutainment applications. The investigated scenarios reveal promising directions for assessing children satisfaction with edutainment applications.

[1]  Stuart MacFarlane,et al.  Using the fun toolkit and other survey methods to gather opinions in child computer interaction , 2006, IDC '06.

[2]  Daniel Kardefelt-Winther,et al.  Helping Parents Make Sense of Video Game Addiction , 2018 .

[3]  Kimberly L. Eaton,et al.  A Meta-Analysis of Family Expressiveness and Children's Emotion Expressiveness and Understanding , 2002 .

[4]  Julia Müller,et al.  Emotional design in multimedia learning: Differentiation on relevant design features and their effects on emotions and learning , 2015, Comput. Hum. Behav..

[5]  J. Piaget.  The construction of reality in the child , 1954 .

[6]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[7]  Jackson Feijó Filho,et al.  Where-How-What Am I Feeling: User Context Logging in Automated Usability Tests for Mobile Software , 2016, HCI.

[8]  Robert Sylwester.  How Emotions Affect Learning. , 1994 .

[9]  C. S. Green,et al.  Children, Wired: For Better and for Worse , 2010, Neuron.

[10]  H. Luczak,et al.  A Product Oriented Approach to Quantify Usability Attributes and the Interactive Quality of User Interfaces , 1993 .

[11]  Vanessa Lobue,et al.  The Child Affective Facial Expression (CAFE) set: validity and reliability from untrained adults , 2014, Front. Psychol..

[12]  Jing He,et al.  A Review on Automatic Facial Expression Recognition Systems Assisted by Multimodal Sensor Data , 2019, Sensors.

[13]  Elizabeth O. Hayward,et al.  Emotional design in multimedia learning: Effects of shape and color on affect and learning , 2014 .

[14]  Edilson de Aguiar,et al.  Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order , 2017, Pattern Recognit..

[15]  Katherine M. Zinsser,et al.  Observing Preschoolers’ Social-Emotional Behavior: Structure, Foundations, and Prediction of Early School Success , 2012, The Journal of genetic psychology.

[16]  Panos Markopoulos,et al.  How to compare usability testing methods with children participants , 2002 .

[17]  Grigoreta-Sofia Cojocar,et al.  Adapting Participatory Design for Romanian Preschoolers Educational Software Development , 2020 .

[18]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[19]  Donald A. Norman,et al.  Emotional design , 2004, UBIQ.

[20]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[21]  Ching-Te Chiu,et al.  A 0.64 mm$^{2}$ Real-Time Cascade Face Detection Design Based on Reduced Two-Field Extraction , 2011, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[22]  Nico H. Frijda,et al.  Varieties of affect: Emotions and episodes, moods, and sentiments. , 1994 .

[23]  ByoungChul Ko,et al.  A Brief Review of Facial Emotion Recognition Based on Visual Information , 2018, Sensors.

[24]  Eunjoon Rachel Um,et al.  Emotional design in multimedia learning. , 2012 .

[25]  Ana Paiva,et al.  Multimodal Affect Modeling and Recognition for Empathic Robot Companions , 2013, Int. J. Humanoid Robotics.

[26]  Kirsten Risden,et al.  Guidelines for usability testing with children , 1997, INTR.

[27]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.