Hyperparameters optimization for Deep Learning based emotion prediction for Human Robot Interaction

To enable humanoid robots to share our social space we need to develop technology for easy interaction with the robots using multiple modes such as speech, gestures and share our emotions with them. We have targeted this research towards addressing the core issue of emotion recognition problem which would require less computation resources and much lesser number of network hyperparameters which will be more adaptive to be computed on low resourced social robots for real time communication. More specifically, here we have proposed an Inception module based Convolutional Neural Network Architecture which has achieved improved accuracy of upto 6% improvement over the existing network architecture for emotion classification when combinedly tested over multiple datasets when tried over humanoid robots in real - time. Our proposed model is reducing the trainable Hyperparameters to an extent of 94% as compared to vanilla CNN model which clearly indicates that it can be used in real time based application such as human robot interaction. Rigorous experiments have been performed to validate our methodology which is sufficiently robust and could achieve high level of accuracy. Finally, the model is implemented in a humanoid robot, NAO in real time and robustness of the model is evaluated.

[1]  Matias Valdenegro-Toro,et al.  Real-time Convolutional Neural Networks for emotion and gender classification , 2017, ESANN.

[2]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[3]  Xuan Yang,et al.  Convolution neural network for automatic facial expression recognition , 2017, 2017 International Conference on Applied System Innovation (ICASI).

[4]  Dong-Wook Lee,et al.  Facial Expression Generation of an Android Robot based on probabilistic Model , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[5]  Xiaodong Wu,et al.  Social Robots for People with Developmental Disabilities: A User Study on Design Features of a Graphical User Interface , 2018, ArXiv.

[6]  Henry Medeiros,et al.  Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine , 2016 .

[7]  Daniele Nardi,et al.  A Deep Learning Approach for Object Recognition with NAO Soccer Robots , 2016, RoboCup.

[8]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Mohammad H. Mahoor,et al.  Going deeper in facial expression recognition using deep neural networks , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[10]  John Atkinson,et al.  Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers , 2016, Expert Syst. Appl..

[11]  Leo Galway,et al.  Feature Extraction for Emotion Recognition and Modelling Using Neurophysiological Data , 2016, 2016 15th International Conference on Ubiquitous Computing and Communications and 2016 International Symposium on Cyberspace and Security (IUCC-CSS).

[12]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[14]  Felipe Trujillo-Romero,et al.  Multimodal emotion recognition with evolutionary computation for human-robot interaction , 2016, Expert Syst. Appl..

[15]  Mohammad H. Mahoor,et al.  A wavelet-based approach to emotion classification using EDA signals , 2018, Expert Syst. Appl..

[16]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Mohammad H. Mahoor,et al.  AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild , 2017, IEEE Transactions on Affective Computing.

[18]  Azar Fazel,et al.  Convolutional Neural Networks for Facial Expression Recognition , 2017, ArXiv.

[19]  Shruti Jaiswal,et al.  Deep Learning based Command Pointing direction estimation using a single RGB Camera , 2018, 2018 5th IEEE Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON).

[20]  Jesús P. Mena-Chalco,et al.  Banco de dados de faces 3D , 2011 .

[21]  Fernando De la Torre,et al.  Learning Spatial and Temporal Cues for Multi-Label Facial Action Unit Detection , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[23]  Tomasz Trzcinski,et al.  I Know How You Feel: Emotion Recognition with Facial Landmarks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  Joshua Correll,et al.  The Chicago face database: A free stimulus set of faces and norming data , 2015, Behavior research methods.

[25]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[26]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[27]  Samit Bhattacharya,et al.  Using Deep and Convolutional Neural Networks for Accurate Emotion Classification on DEAP Dataset , 2017, AAAI.

[28]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[30]  Prudhvi Raj Dachapally Facial Emotion Detection Using Convolutional Neural Networks and Representational Autoencoder Units , 2017, ArXiv.

[31]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Liping Shen,et al.  Facial Expression Recognition Based on SVM in E-learning , 2012 .