A Review of Computational Approaches for Human Behavior Detection

Computer vision techniques capable of detecting human behavior are gaining interest. Several researchers have provided their review on behavior detection, however most of the reviews are focused on activity recognition only, and reviews on gesture and facial expression recognition are very few. Therefore, all of them lack to cover complete human behavior analysis. In this study, we provide a comprehensive review of human behavior detection approaches. The framework of this review is based on activity, gesture and facial expression recognition since these are the most important cues for behavior detection. These three areas are further classified in existing computational approaches. One can easily recognize from this review that hidden Markov model is widely exploited for activity recognition while motion history image is still a developing area. Haar-like features can be a valid alternative for gesture recognition. For facial expression recognition, local binary patterns feature is a very popular choice. We have reviewed behavior detection techniques, mostly developed after year 2009. The explicit advantages of this review are: (1) it provides a deep analysis of computational approaches for activity, gesture and facial expression recognition. (2) It includes both types of techniques that include single human as well as multiple human activities. (3) It considers techniques developed in the last decade only pertaining to information about the most recent techniques. (4) It provides a brief description of popular datasets used for activity, gesture and facial expression recognition. (5) It discusses open issues to provide an insight for future also.

[1]  Md. Atiqur Rahman Ahad,et al.  Action dataset — A survey , 2011, SICE Annual Conference 2011.

[2]  R.C. Luo,et al.  NCCU Security Warrior: An Intelligent Security Robot System , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[3]  Stephen J. Maybank,et al.  Activity recognition using a supervised non-parametric hierarchical HMM , 2016, Neurocomputing.

[4]  Hossein Ragheb,et al.  MuHAVi: A Multicamera Human Action Video Dataset for the Evaluation of Action Recognition Methods , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[5]  Wolfgang Hübner,et al.  Action Recognition in the Longwave Infrared and the Visible Spectrum Using Hough Forests , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[6]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, ICPR 2004.

[7]  Yongzhao Zhan,et al.  A neural-AdaBoost based facial expression recognition system , 2014, Expert Syst. Appl..

[8]  C. V. Jawahar,et al.  Trajectory aligned features for first person action recognition , 2016, Pattern Recognit..

[9]  Md. Atiqur Rahman Ahad,et al.  Activity representation by SURF-based templates , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[10]  Cordelia Schmid,et al.  Actions in context , 2009, CVPR.

[11]  Maja Pantic,et al.  Automatic Analysis of Facial Actions: A Survey , 2019, IEEE Transactions on Affective Computing.

[12]  Silvio Savarese,et al.  What are they doing? : Collective activity classification using spatio-temporal relationship among people , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[13]  D. Gnanadurai,et al.  Shape-based features for reliable action recognition using spectral regression discriminant analysis , 2016 .

[14]  Plamen Angelov,et al.  Vision Based Human Activity Recognition: A Review , 2016, UKCI.

[15]  Victor Uc-Cetina,et al.  Body Gestures Recognition System to Control a Service Robot , 2017 .

[16]  Gwen Littlewort,et al.  Automatic coding of facial expressions displayed during posed and genuine pain , 2009, Image Vis. Comput..

[17]  Swati Nigam,et al.  On human activity recognition in video sequences , 2011, 2011 2nd International Conference on Computer and Communication Technology (ICCCT-2011).

[18]  Dan Xu,et al.  Online Dynamic Gesture Recognition for Human Robot Interaction , 2015, J. Intell. Robotic Syst..

[19]  Michael J. Lyons,et al.  Evidence and a computational explanation of cultural differences in facial expression recognition. , 2010, Emotion.

[20]  Sheng Bi,et al.  Real-time gesture recognition system based on Camshift algorithm and Haar-like feature , 2016, 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[21]  Md. Atiqur Rahman Ahad,et al.  Computer Vision and Action Recognition - A Guide for Image Processing and Computer Vision Community for Action Understanding , 2011, Atlantis Ambient and Pervasive Intelligence.

[22]  Masaki Hayashi,et al.  Recognition of Transitional Action for Short-Term Action Prediction using Discriminative Temporal CNN Feature , 2016, BMVC.

[23]  Jun Zhou,et al.  Recognizing human actions from silhouettes described with weighted distance metric and kinematics , 2017, Multimedia Tools and Applications.

[24]  Bipin Indurkhya,et al.  A novel human robot interaction using the Wiimote , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[25]  Youdong Ding,et al.  An Improved Algorithm of Hand-Gesture Recognition Based on Haar-Like Features and Adaboost , 2012 .

[26]  Manasi S. Patwardhan,et al.  Survey on real-time facial expression recognition techniques , 2016, IET Biom..

[27]  Md. Atiqur Rahman Ahad,et al.  Pedestrian activity classification using patterns of motion and histogram of oriented gradient , 2016, Journal on Multimodal User Interfaces.

[28]  Michel F. Valstar,et al.  Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[29]  Md. Atiqur Rahman Ahad,et al.  Motion history image: its variants and applications , 2012, Machine Vision and Applications.

[30]  Rabul Hussain Laskar,et al.  Recognition of global hand gestures using self co-articulation information and classifier fusion , 2016, Journal on Multimodal User Interfaces.

[31]  Chu-Sing Yang,et al.  Human Action Recognition Using Motion History Image Based Temporal Segmentation , 2016, Int. J. Pattern Recognit. Artif. Intell..

[32]  Mikaël A. Mousse,et al.  Robust Facial Expression Recognition Using Evidential Hidden Markov Model , 2017 .

[33]  Mohammad Mehedi Hassan,et al.  A depth video-based facial expression recognition system using radon transform, generalized discriminant analysis, and hidden Markov model , 2013, Multimedia Tools and Applications.

[34]  Stephen J. McKenna,et al.  Computer Vision and Image Understanding Recognising Complex Activities with Histograms of Relative Tracklets , 2022 .

[35]  Hyo-Rim Choi,et al.  Combined Dynamic Time Warping with Multiple Sensors for 3D Gesture Recognition , 2017, Sensors.

[36]  Hao Wang,et al.  Exploring hybrid spatio-temporal convolutional networks for human action recognition , 2017, Multimedia Tools and Applications.

[37]  Hironobu Fujiyoshi,et al.  A System for Video Surveillance and Monitoring CMU VSAM Final Report , 1999 .

[38]  Antônio L. Apolinário,et al.  Real-time 3D Gesture Recognition using Dynamic Time Warping and Simplification Methods , 2017, J. WSCG.

[39]  Zhiyong Feng,et al.  Hidden Markov Model Decision Forest for Dynamic Facial Expression Recognition , 2015, Int. J. Pattern Recognit. Artif. Intell..

[40]  Sungyoung Lee,et al.  Human Facial Expression Recognition Using Stepwise Linear Discriminant Analysis and Hidden Conditional Random Fields , 2015, IEEE Transactions on Image Processing.

[41]  Jake K. Aggarwal,et al.  Multitype Activity Recognition in Robot-Centric Scenarios , 2015, IEEE Robotics and Automation Letters.

[42]  Sang-Heon Lee,et al.  A comparison of 3D hand gesture recognition using dynamic time warping , 2012, IVCNZ '12.

[43]  Margrit Betke,et al.  Personalizing Gesture Recognition Using Hierarchical Bayesian Neural Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Changqin Quan,et al.  Facial expression recognition based on Gabor Wavelet transform and Histogram of Oriented Gradients , 2015, 2015 IEEE International Conference on Mechatronics and Automation (ICMA).

[45]  Jochen Triesch,et al.  A System for Person-Independent Hand Posture Recognition against Complex Backgrounds , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Ana-Maria Cretu,et al.  Static and Dynamic Hand Gesture Recognition in Depth Data Using Dynamic Time Warping , 2016, IEEE Transactions on Instrumentation and Measurement.

[47]  Siddharth Swarup Rautaray,et al.  Real Time Gesture Recognition System for Interaction in Dynamic Environment , 2012 .

[48]  Q. M. Jonathan Wu,et al.  Facial expression recognition using curvelet based local binary patterns , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[49]  Jean Meunier,et al.  Emotion recognition using dynamic grid-based HoG features , 2011, Face and Gesture 2011.

[50]  Guoming Chen,et al.  Facial Expression Recognition Based on Gabor Wavelet Transform and Relevance Vector Machine , 2014 .

[51]  Alberto Del Bimbo,et al.  Motion segment decomposition of RGB-D sequences for human behavior understanding , 2017, Pattern Recognit..

[52]  Xinyu Wu,et al.  The spatial Laplacian and temporal energy pyramid representation for human action recognition using depth sequences , 2017, Knowl. Based Syst..

[53]  Hadi Seyedarabi,et al.  Hybrid method for hand gesture recognition based on combination of Haar-like and HOG features , 2013, 2013 21st Iranian Conference on Electrical Engineering (ICEE).

[54]  Uipil Chong,et al.  Facial Expression Recognition Using Local Transitional Pattern on Gabor Filtered Facial Images , 2013 .

[55]  Stefanos Zafeiriou,et al.  Recognition of 3D facial expression dynamics , 2012, Image Vis. Comput..

[56]  Hugo Jair Escalante,et al.  A naïve Bayes baseline for early gesture recognition , 2016, Pattern Recognit. Lett..

[57]  C. Krishna Mohan,et al.  Graph formulation of video activities for abnormal activity recognition , 2017, Pattern Recognit..

[58]  Gunasekaran Manogaran,et al.  Wearable sensor devices for early detection of Alzheimer disease using dynamic time warping algorithm , 2018, Cluster Computing.

[59]  Ming Shao,et al.  A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[60]  Mignon Park,et al.  Continuous Human Action Recognition Using Depth-MHI-HOG and a Spotter Model , 2015, Sensors.

[61]  Djamel Bouchaffra,et al.  3D HMM-based Facial Expression Recognition using Histogram of Oriented Optical Flow , 2016 .

[62]  Swati Nigam,et al.  Integration of moment invariants and uniform local binary patterns for human activity recognition in video sequences , 2016, Multimedia Tools and Applications.

[63]  Zicheng Liu,et al.  Cross-dataset action detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[64]  Seiichi Serikawa,et al.  Human Action Recognition: A Template Matching-based Approach , 2017, Journal of the Institute of Industrial Applications Engineers.

[65]  Yanan Xu,et al.  Review of hand gesture recognition study and application , 2017 .

[66]  Alberto Del Bimbo,et al.  3D facial expression recognition using SIFT descriptors of automatically detected keypoints , 2011, The Visual Computer.

[67]  Yiheng Cai,et al.  3D facial expression recognition using distance features and LBP features based on automatically detected keypoints , 2016, 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[68]  Jing Zhang,et al.  RGB-D-based action recognition datasets: A survey , 2016, Pattern Recognit..

[69]  Zhi Liu,et al.  3D-based Deep Convolutional Neural Network for action recognition with depth sequences , 2016, Image Vis. Comput..

[70]  Anupam Agrawal,et al.  Real Time Hand Detection & Tracking for Dynamic Gesture Recognition , 2015 .

[71]  Ayyaz Hussain,et al.  Multi-stage binary patterns for facial expression recognition in real world , 2018, Cluster Computing.

[72]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[73]  F. Strack,et al.  Reflection and Impulse as Determinants of Human Behavior , 2017 .

[74]  Rabul Hussain Laskar,et al.  Hand gesture recognition using two-level speed normalization, feature selection and classifier fusion , 2017, Multimedia Systems.

[75]  Cordelia Schmid,et al.  Dense Trajectories and Motion Boundary Descriptors for Action Recognition , 2013, International Journal of Computer Vision.

[76]  M. Abdullah-Al-Wadud,et al.  Facial Expression Recognition From Depth Video With Patterns of Oriented Motion Flow , 2017, IEEE Access.

[77]  Ramón F. Brena,et al.  Multi-view stacking for activity recognition with sound and accelerometer data , 2018, Inf. Fusion.

[78]  Chen-Chiung Hsieh,et al.  Novel Haar features for real-time hand gesture recognition using SVM , 2012, Journal of Real-Time Image Processing.

[79]  David Picard,et al.  Learning features combination for human action recognition from skeleton sequences , 2017, Pattern Recognit. Lett..

[80]  Andrea Cavallaro,et al.  Learning Bases of Activity for Facial Expression Recognition , 2017, IEEE Transactions on Image Processing.

[81]  Clément Chatelain,et al.  Gesture sequence recognition with one shot learned CRF/HMM hybrid model , 2017, Image Vis. Comput..

[82]  Hacer Yalim Keles,et al.  Action recognition using MHI based Hu moments with HMMs , 2017, IEEE EUROCON 2017 -17th International Conference on Smart Technologies.

[83]  Rajendran Parthiban,et al.  Joint facial expression recognition and intensity estimation based on weighted votes of image sequences , 2017, Pattern Recognit. Lett..

[84]  Allen Y. Yang,et al.  DexterNet: An Open Platform for Heterogeneous Body Sensor Networks and its Applications , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[85]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[86]  M. Sharif,et al.  Hexagonal scale invariant feature transform (H-SIFT) for facial feature extraction , 2015 .

[87]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[88]  Qing Chen,et al.  Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar , 2008, IEEE Transactions on Instrumentation and Measurement.

[89]  Yuehong Shen,et al.  A Noisy-Robust Approach for Facial Expression Recognition , 2017, KSII Trans. Internet Inf. Syst..

[90]  Jun-Jie Wang,et al.  Improvement of Dynamic Hand Gesture Recognition Based on HMM Algorithm , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[91]  Honggang Zhang,et al.  Joint Patch and Multi-label Learning for Facial Action Unit and Holistic Expression Recognition , 2016, IEEE Transactions on Image Processing.

[92]  Thomas S. Huang,et al.  A novel approach to expression recognition from non-frontal face images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[93]  Nirvair Neeru,et al.  Modified SIFT Descriptors for Face Recognition under Different Emotions , 2016 .

[94]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[95]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[96]  Mubarak Shah,et al.  Action MACH a spatio-temporal Maximum Average Correlation Height filter for action recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[97]  Ying Wang,et al.  Human Activity Recognition Based on R Transform , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[98]  Shahrokh Valaee,et al.  Accelerometer-based gesture recognition via dynamic-time warping, affinity propagation, & compressive sensing , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[99]  Hassen Drira,et al.  4-D Facial Expression Recognition by Learning Geometric Deformations , 2014, IEEE Transactions on Cybernetics.

[100]  Pavlo Molchanov,et al.  Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[101]  Senem Velipasalar,et al.  A Survey on Activity Detection and Classification Using Wearable Sensors , 2017, IEEE Sensors Journal.

[102]  Nicholas Stergiou,et al.  Nonlinear Analysis for Human Movement Variability , 2016 .

[103]  Tardi Tjahjadi,et al.  A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences , 2015, Pattern Recognit..

[104]  Swati Nigam,et al.  Efficient facial expression recognition using histogram of oriented gradients in wavelet domain , 2018, Multimedia Tools and Applications.

[105]  Johannes D. Krijnders,et al.  CASSANDRA: audio-video sensor fusion for aggression detection , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[106]  Juergen Gall,et al.  A bag-of-words equivalent recurrent neural network for action recognition , 2017, Comput. Vis. Image Underst..

[107]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[108]  Renqiang Xie,et al.  Accelerometer-Based Hand Gesture Recognition by Neural Network and Similarity Matching , 2016, IEEE Sensors Journal.

[109]  Aurobinda Routray,et al.  A real-time robust facial expression recognition system using HOG features , 2016, 2016 International Conference on Computing, Analytics and Security Trends (CAST).

[110]  Hung-Hsu Tsai,et al.  Facial expression recognition using a combination of multiple facial features and support vector machine , 2018, Soft Comput..

[111]  Naranker Dulay,et al.  TRAcME: Temporal Activity Recognition Using Mobile Phone Data , 2008, 2008 IEEE/IFIP International Conference on Embedded and Ubiquitous Computing.

[112]  Md. Mohiminul Islam,et al.  Real time Hand Gesture Recognition using different algorithms based on American Sign Language , 2017, 2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR).

[113]  Sébastien Marcel,et al.  Hand Posture Recognition in a Body-Face Centered Space , 1999, Gesture Workshop.

[114]  Archana Ghotkar,et al.  Dynamic Hand Gesture Recognition using Hidden Markov Model by Microsoft Kinect Sensor , 2016 .

[115]  Yong Haur Tay,et al.  Abnormal Event Detection in Videos using Spatiotemporal Autoencoder , 2017, ISNN.

[116]  Titus B. Zaharia,et al.  Laban movement analysis and hidden Markov models for dynamic 3D gesture recognition , 2017, EURASIP J. Image Video Process..

[117]  H. Seyedarabi,et al.  Real-time dynamic hand gesture recognition using hidden Markov models , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[118]  Swati Nigam,et al.  Towards Classification Based Human Activity Recognition in Video Sequences , 2013, ICCASA.

[119]  Zhikai Zong.  Efficient Human Face Recognition Method under Subtle SIFT Features Using Optimized K-means , 2017 .

[120]  Stefan Wermter,et al.  Self-organizing neural integration of pose-motion features for human action recognition , 2015, Front. Neurorobot..

[121]  Tao Mei,et al.  Learning hierarchical video representation for action recognition , 2017, International Journal of Multimedia Information Retrieval.

[122]  Vassilios Petridis,et al.  Detection and identification of human actions using Predictive Modular Neural Networks , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[123]  Antonio Fernández-Caballero,et al.  A survey of video datasets for human action and activity recognition , 2013, Comput. Vis. Image Underst..

[124]  Koichi Shinoda,et al.  Cross-view human action recognition from depth maps using spectral graph sequences , 2017, Comput. Vis. Image Underst..

[125]  Vincent Lepetit,et al.  Pose-specific non-linear mappings in feature space towards multiview facial expression recognition , 2017, Image Vis. Comput..

[126]  Stefan Wermter,et al.  Emergence of multimodal action representations from neural network self-organization , 2017, Cognitive Systems Research.

[127]  Abdulghani Ali,et al.  Attack Intention Recognition: A Review , 2017, Int. J. Netw. Secur..

[128]  Sergio Escalera,et al.  Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[129]  Deba Prasad Dash,et al.  Hidden Markov Model based human activity recognition using shape and optical flow based features , 2016, 2016 IEEE Region 10 Conference (TENCON).

[130]  Fuji Ren,et al.  Facial expression recognition based on AAM–SIFT and adaptive regional weighting , 2015 .

[131]  Tae-Kyun Kim,et al.  Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[132]  Wei Liu,et al.  Feature fusion of HOG and WLD for facial expression recognition , 2013, Proceedings of the 2013 IEEE/SICE International Symposium on System Integration.

[133]  Ling Shao,et al.  Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[134]  Wenfeng Li,et al.  Optimizing multi-sensor deployment via ensemble pruning for wearable activity recognition , 2018, Inf. Fusion.

[135]  Alaa Eleyan,et al.  Gabor wavelet transform based facial expression recognition using PCA and LBP , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[136]  Alberto Del Bimbo,et al.  A Set of Selected SIFT Features for 3D Facial Expression Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[137]  Tim J. Ellis,et al.  ViHASi: Virtual human action silhouette data for the performance evaluation of silhouette-based action recognition methods , 2008, ICDSC.

[138]  Anand Singh Jalal,et al.  Suspicious human activity recognition: a review , 2017, Artificial Intelligence Review.

[139]  Jordi Gonzàlez,et al.  Human Pose Estimation from Monocular Images: A Comprehensive Survey , 2016, Sensors.

[140]  Kostas Karpouzis,et al.  SOMM: Self organizing Markov map for gesture recognition , 2010, Pattern Recognit. Lett..

[141]  Mubarak Shah,et al.  Motion-Based Recognition , 1997, Computational Imaging and Vision.

[142]  Swati Nigam,et al.  Automatic human activity recognition in video using background modeling and spatio-temporal template matching based technique , 2011, ACAI '11.

[143]  Takeo Kanade,et al.  Dense 3D face alignment from 2D video for real-time use , 2017, Image Vis. Comput..

[144]  Erik Cambria,et al.  A review of affective computing: From unimodal analysis to multimodal fusion , 2017, Inf. Fusion.

[145]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[146]  Mehryar Emambakhsh,et al.  Nasal Patches and Curves for Expression-Robust 3D Face Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[147]  Bart Selman,et al.  Unstructured human activity detection from RGBD images , 2011, 2012 IEEE International Conference on Robotics and Automation.

[148]  L. Mathew,et al.  Increasing trend of wearables and multimodal interface for human activity monitoring: A review. , 2017, Biosensors & bioelectronics.

[149]  Bo Zhang,et al.  Facial expression recognition based on Gabor and conditional random fields , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[150]  Matti Pietikäinen,et al.  Discriminative Spatiotemporal Local Binary Pattern with Revisited Integral Projection for Spontaneous Facial Micro-Expression Recognition , 2019, IEEE Transactions on Affective Computing.

[151]  Eun-Soo Kim,et al.  Human facial expression recognition using curvelet feature extraction and normalized mutual information feature selection , 2014, Multimedia Tools and Applications.

[152]  Soma Mitra,et al.  Vision based Hand Gesture Recognition using Dynamic Time Warping for Indian Sign Language , 2016, 2016 International Conference on Information Science (ICIS).

[153]  Alaa Eleyan,et al.  Comparative Study on Facial Expression Recognition using Gabor and Dual-Tree Complex Wavelet Transforms , 2017 .

[154]  Sriparna Saha,et al.  HMM-based gesture recognition system using kinect sensor for improvised human-computer interaction , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[155]  Sébastien Marcel,et al.  Hand gesture recognition using input-output hidden Markov models , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[156]  Kai Tang,et al.  Kernel fusion based extreme learning machine for cross-location activity recognition , 2017, Inf. Fusion.

[157]  Yibin Li,et al.  Facial Expression Recognition with Fusion Features Extracted from Salient Facial Areas , 2017, Sensors.

[158]  Shaharyar Kamal,et al.  A Hybrid Feature Extraction Approach for Human Detection, Tracking and Activity Recognition Using Depth Sensors , 2016 .

[159]  Lu Yang,et al.  Survey on 3D Hand Gesture Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[160]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[161]  Cem Ersoy,et al.  Multi-resident activity tracking and recognition in smart environments , 2017, Journal of Ambient Intelligence and Humanized Computing.

[162]  Daijin Kim,et al.  Depth Images-based Human Detection, Tracking and Activity Recognition Using Spatiotemporal Features and Modified HMM , 2016 .

[163]  Xiao-Ping Zhang,et al.  A Hierarchical Spatio-Temporal Model for Human Activity Recognition , 2017, IEEE Transactions on Multimedia.

[164]  Xiaojun Wu,et al.  Facial expression recognition using ELBP based on covariance matrix transform in KLT , 2016, Multimedia Tools and Applications.

[165]  Alois Knoll,et al.  Using a Na"ive Bayes Classifier based on K-Nearest Neighbors with Distance Weighting for Static Hand-Gesture Recognition in a Human-Robot Dialog System , 2008 .

[166]  Swati Nigam,et al.  Multiscale Local Binary Patterns for Facial Expression-Based Human Emotion Recognition , 2015 .

[167]  M. Sundarambal,et al.  FPGA implementation of hand gesture recognition system using neural networks , 2017, 2017 11th International Conference on Intelligent Systems and Control (ISCO).

[168]  Thamer Horbylon Nascimento,et al.  Method for Text Entry in Smartwatches Using Continuous Gesture Recognition , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[169]  Carlos Medrano,et al.  Fast Simplex-HMM for One-Shot Learning Activity Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[170]  Alois Knoll,et al.  A Naïve Bayes Classifier with Distance Weighting for Hand-Gesture Recognition , 2008 .

[171]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[172]  Ayoub Al-Hamadi,et al.  A Discriminative Framework for Action Recognition Using f-HOL Features , 2016, Inf..

[173]  Nazli Ikizler-Cinbis,et al.  Space-Time Tree Ensemble for Action Recognition and Localization , 2018, International Journal of Computer Vision.

[174]  Byungyong Ryu,et al.  Local Directional Ternary Pattern for Facial Expression Recognition , 2017, IEEE Transactions on Image Processing.

[175]  Tao Mei,et al.  Exploiting spatial-temporal context for trajectory based action video retrieval , 2017, Multimedia Tools and Applications.

[176]  Paul Suetens,et al.  meshSIFT: Local surface features for 3D face recognition under expression variations and partial data , 2013, Comput. Vis. Image Underst..

[177]  Stefan Wermter,et al.  Lifelong learning of human actions with deep neural network self-organization , 2017, Neural Networks.

[178]  Haibin Ling,et al.  Human activity prediction using temporally-weighted generalized time warping , 2017, Neurocomputing.

[179]  Li-Chen Fu,et al.  Robust dynamic hand gesture recognition system with sparse steric haar-like feature for human robot interaction , 2016, 2016 55th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[180]  Timothy H. Lucas,et al.  The Virtual Trackpad: An Electromyography-Based, Wireless, Real-Time, Low-Power, Embedded Hand-Gesture-Recognition System Using an Event-Driven Artificial Neural Network , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[181]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[182]  Hong Cheng,et al.  An image-to-class dynamic time warping approach for both 3D static and trajectory hand gesture recognition , 2016, Pattern Recognit..

[183]  Dimitrios Makris,et al.  One-Shot Learning of Human Activity With an MAP Adapted GMM and Simplex-HMM , 2017, IEEE Transactions on Cybernetics.

[184]  Yuan Luo,et al.  Facial expression recognition based on fusion feature of PCA and LBP with SVM , 2013 .

[185]  Tiejun Huang,et al.  Sequential Deep Trajectory Descriptor for Action Recognition With Three-Stream CNN , 2016, IEEE Transactions on Multimedia.

[186]  Yuichi Ohta,et al.  MMID: Multimodal Multi-view Integrated Database for human behavior understanding , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[187]  Fuji Ren Member,et al.  Facial expression recognition based on AAM–SIFT and adaptive regional weighting , 2015 .