Sparse representation based classification scheme for human activity recognition using smartphones

The availability of built-in sensors in mobile devices have paved a way for researchers to accurately determine human activities through these sensors. In this paper, we present a novel action recognition system based on sparse representation wherein, eight different human activities were classified. Our proposed classifier employs data of accelerometer, gyroscope, magnetometer and orientation sensor equipped in smartphones for recognizing human activities. Time-domain and frequency-domain features are derived from the acquired sensor data. We have introduced a novel algorithm for fusing the data from the four sensors using a sparse representation based technique that aid in achieving the best classification performance. In the proposed algorithm, if the majority of the sensors indicate a particular class as the output, then that specific class is assigned as the actual test class. However, if there is a disagreement between the classified output of different sensors, then a novel weighted fusion scheme is introduced to fuse the scores and the residue produced by different sensors. The weight used in fusion is chosen to be the standard deviation of the score vector. Thus, the features of excellent sensors are made to bestow more on to the result of action recognition. Finally, the action label is recognized based on an activity metric that maximizes the score while minimizing the residue. The performance analysis of the proposed system is performed using leave-one-subject-out approach. Performance evaluation metrics like recall, precision, specificity, F-score and accuracy are utilized in projecting the performance of the proposed system. It was shown that the proposed system attained a high overall accuracy of about 97.13%.

[1]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Ye Li,et al.  A Wearable Context-Aware ECG Monitoring System Integrated with Built-in Kinematic Sensors of the Smartphone , 2015, Sensors.

[3]  Allen Y. Yang,et al.  Distributed recognition of human actions using wearable motion sensor networks , 2009, J. Ambient Intell. Smart Environ..

[4]  Robert B. McGhee,et al.  Estimation of Human Foot Motion During Normal Walking Using Inertial and Magnetic Sensor Measurements , 2012, IEEE Transactions on Instrumentation and Measurement.

[5]  Zhu Xiao,et al.  Energy-efficient recognition of human activity in body sensor networks via compressed classification , 2016, Int. J. Distributed Sens. Networks.

[6]  Liang Yin,et al.  A high-performance training-free approach for hand gesture recognition with accelerometer , 2013, Multimedia Tools and Applications.

[7]  R. Amutha,et al.  A novel chaotic map based compressive classification scheme for human activity recognition using a tri-axial accelerometer , 2018, Multimedia Tools and Applications.

[8]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[9]  Jun Zhong,et al.  Towards unsupervised physical activity recognition using smartphone accelerometers , 2016, Multimedia Tools and Applications.

[10]  Cecilio Angulo,et al.  Online motion recognition using an accelerometer in a mobile device , 2012, Expert Syst. Appl..

[11]  Toon De Pessemier,et al.  Context-aware recommendations through context and activity recognition in a mobile environment , 2014, Multimedia Tools and Applications.

[12]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[13]  Binh Q. Tran,et al.  Optimization of an Accelerometer and Gyroscope-Based Fall Detection Algorithm , 2015, J. Sensors.

[14]  Vadim V. Strijov,et al.  Human activity recognition using quasiperiodic time series collected from a single tri-axial accelerometer , 2016, Multimedia Tools and Applications.

[15]  Guang-Zhong Yang,et al.  Sensor Positioning for Activity Recognition Using Wearable Accelerometers , 2011, IEEE Transactions on Biomedical Circuits and Systems.

[16]  R. Amutha,et al.  A novel framework for action recognition based on histogram of oriented gradients and sparsity-inducing shared dictionary , 2017, 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[17]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[18]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[19]  Lei Gao,et al.  Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems. , 2014, Medical engineering & physics.

[20]  David Zhang,et al.  Combine crossing matching scores with conventional matching scores for bimodal biometrics and face and palmprint recognition experiments , 2011, Neurocomputing.

[21]  Tanaya Guha,et al.  Learning Sparse Representations for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[23]  Noel E. O'Connor,et al.  Classification of Sporting Activities Using Smartphone Accelerometers , 2013, Sensors.

[24]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[25]  Imran A. Zualkernan,et al.  Emotion recognition using mobile phones , 2016, 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom).

[26]  Yuwu Lu,et al.  Adaptive weighted fusion: A novel fusion approach for image classification , 2015, Neurocomputing.

[27]  Isabel N. Figueiredo,et al.  Exploring smartphone sensors for fall detection , 2016, mUX: The Journal of Mobile User Experience.

[28]  Shutao Li,et al.  Remote Sensing Image Fusion Method Based on Nonsubsampled Shearlet Transform and Sparse Representation , 2015, Sensing and Imaging.

[29]  Xiaomu Luo,et al.  Simultaneous Indoor Tracking and Activity Recognition Using Pyroelectric Infrared Sensors , 2017, Sensors.

[30]  Xiangmin Xu,et al.  Robust object tracking based on sparse representation and incremental weighted PCA , 2016, Multimedia Tools and Applications.

[31]  Mi Zhang,et al.  Human Daily Activity Recognition With Sparse Representation Using Wearable Sensors , 2013, IEEE Journal of Biomedical and Health Informatics.

[32]  C. Krishna Mohan,et al.  Sparsity-inducing dictionaries for effective action classification , 2016, Pattern Recognit..

[33]  Jake K. Aggarwal,et al.  Human activity recognition from 3D data: A review , 2014, Pattern Recognit. Lett..

[34]  Zhihan Lv,et al.  Towards a face recognition method based on uncorrelated discriminant sparse preserving projection , 2017, Multimedia Tools and Applications.

[35]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[36]  Hong Cheng,et al.  Real world activity summary for senior home monitoring , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[37]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[38]  Shuangquan Wang,et al.  A review on radio based activity recognition , 2015, Digit. Commun. Networks.

[39]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[40]  Wesley De Neve,et al.  Effective and efficient human action recognition using dynamic frame skipping and trajectory rejection , 2017, Image Vis. Comput..

[41]  Héctor Pomares,et al.  MIMU-Wear: Ontology-based sensor selection for real-world wearable activity recognition , 2017, Neurocomputing.

[42]  Araceli Sanchis,et al.  Sensor-based Bayesian detection of anomalous living patterns in a home setting , 2014, Personal and Ubiquitous Computing.

[43]  John Paul Varkey,et al.  Human motion recognition using a wireless sensor-based wearable system , 2012, Personal and Ubiquitous Computing.

[44]  Michael Elad,et al.  Applications of Sparse Representation and Compressive Sensing , 2010, Proc. IEEE.

[45]  Hassan Ghasemzadeh,et al.  Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges , 2017, Inf. Fusion.

[46]  Amir H. Behzadan,et al.  Smartphone-based construction workers' activity recognition and classification , 2016 .

[47]  Cagatay Catal,et al.  On the use of ensemble of classifiers for accelerometer-based activity recognition , 2015, Appl. Soft Comput..

[48]  Jun Gao,et al.  Learning universal multiview dictionary for human action recognition , 2017, Pattern Recognit..

[49]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[50]  Weiqiang Wang,et al.  Elderly Safety: A Smartphone Based Real Time Approach , 2013, ICOST.

[51]  Vivek Kanhangad,et al.  Exploring orientation and accelerometer sensor data for personal authentication in smartphones using touchscreen gestures , 2015, Pattern Recognit. Lett..

[52]  Shiqing Zhang,et al.  Robust emotion recognition in noisy speech via sparse representation , 2013, Neural Computing and Applications.