Optimizing multi-sensor deployment via ensemble pruning for wearable activity recognition

Abstract With the rapid development of sensor types and processers, most wearable activity recognition systems tend to making use of multiple homogeneous or heterogeneous sensors to obtain plethora information. However, in a realistic environment, it is difficult to configure an appropriate multi-sensor deployment to gain a tradeoff among computational complexity, accuracy and subject personality. In this paper, a multi-sensor fusion with ensemble pruning system (MSF-EP) is designed to connect with multi-sensor based wearable activity recognition system. As a result, the multi-sensor configuration problem is transformed to multiple ensemble classifier pruning problem. With respect to ensemble pruning for MSF-EP system, two popular order-based ensemble pruning approaches are utilized firstly: reduce-error pruning (RE) and complementarily pruning (Comp). Then, in light of the proposed MSF-EP system, two new ensemble pruning criteria are proposed: mRMR pruning and discriminative pruning (Disc). The mRMR pruning measure is based on mutual information and is a composite criterion of classifier redundancy and relevance with regard to the selected classifier set. Taking into account the discriminations of misclassified instances and correctly classified instances in classifier subset selected respectively, another ensemble pruning measure Disc, which combining RE pruning and Comp pruning, is presented in the form of mutual information also. Finally, the proposed pruning learner with lower error is selected as final ensemble classifier. Through the algorithm, the number and type of multi-sensor are appropriately decided to optimize the multi-sensor fusion without regrading the accuracy performance. The system conducts experimental studies on two real-world activity recognition data sets and the results show the superiority of system over other ensemble algorithms.

[1]  Hassan Ghasemzadeh,et al.  Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges , 2017, Inf. Fusion.

[2]  Hai Zhao,et al.  Parallelized extreme learning machine ensemble based on min-max modular network , 2014, Neurocomputing.

[3]  Xindong Wu,et al.  Ensemble pruning via individual contribution ordering , 2010, KDD.

[4]  Aníbal R. Figueiras-Vidal,et al.  Post-aggregation of classifier ensembles , 2015, Inf. Fusion.

[5]  Han Wang,et al.  Ensemble Based Extreme Learning Machine , 2010, IEEE Signal Processing Letters.

[6]  Djamel Bouchaffra,et al.  An efficient ensemble pruning approach based on simple coalitional games , 2017, Inf. Fusion.

[7]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[8]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[9]  Nasser Kehtarnavaz,et al.  Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors , 2015, IEEE Transactions on Human-Machine Systems.

[10]  Gwenn Englebienne,et al.  In-Home Activity Recognition: Bayesian Inference for Hidden Markov Models , 2014, IEEE Pervasive Computing.

[11]  Simon A. Dobson,et al.  KCAR: A knowledge-driven approach for concurrent activity recognition , 2015, Pervasive Mob. Comput..

[12]  Weihua Sheng,et al.  Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Weiming Shao,et al.  Semi-supervised selective ensemble learning based on distance to model for nonlinear soft sensor development , 2017, Neurocomputing.

[14]  Xuelong Li,et al.  Rank Preserving Discriminant Analysis for Human Behavior Recognition on Wireless Sensor Networks , 2014, IEEE Transactions on Industrial Informatics.

[15]  Hassan Ghasemzadeh,et al.  Power-Aware Activity Monitoring Using Distributed Wearable Sensors , 2014, IEEE Transactions on Human-Machine Systems.

[16]  Ratna Babu Chinnam,et al.  mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification , 2011, Inf. Sci..

[17]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[18]  Fikret S. Gürgen,et al.  A feature selection method based on kernel canonical correlation analysis and the minimum Redundancy-Maximum Relevance filter method , 2012, Expert Syst. Appl..

[19]  Daniel Hernández-Lobato,et al.  An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[21]  Yiwen Wan,et al.  Feature and decision level fusion for action recognition , 2012, 2012 Third International Conference on Computing, Communication and Networking Technologies (ICCCNT'12).

[22]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[23]  Giancarlo Fortino,et al.  A framework for collaborative computing and multi-sensor data fusion in body sensor networks , 2015, Inf. Fusion.

[24]  Andrea Passerini,et al.  Improving Activity Recognitionby Segmental Pattern Mining , 2014, IEEE Trans. Knowl. Data Eng..

[25]  Thomas G. Dietterich,et al.  Pruning Adaptive Boosting , 1997, ICML.

[26]  Billur Barshan,et al.  Recognizing Daily and Sports Activities in Two Open Source Machine Learning Environments Using Body-Worn Sensor Units , 2014, Comput. J..

[27]  Jian Lu,et al.  A Pattern Mining Approach to Sensor-Based Human Activity Recognition , 2011, IEEE Transactions on Knowledge and Data Engineering.

[28]  Ting Zhang,et al.  A new reverse reduce-error ensemble pruning algorithm , 2015, Appl. Soft Comput..

[29]  L. Benini,et al.  Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[30]  Bala Srinivasan,et al.  Adaptive mobile activity recognition system with evolving data streams , 2015, Neurocomputing.

[31]  Ricardo Chavarriaga,et al.  Benchmarking classification techniques using the Opportunity human activity dataset , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[32]  Chongzhao Han,et al.  Fusion of Gaussian mixture models for possible mismatches of sensor model , 2014, Inf. Fusion.

[33]  Bernt Schiele,et al.  Weakly Supervised Recognition of Daily Life Activities with Wearable Sensors , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Jing Li,et al.  Improving positioning accuracy of vehicular navigation system during GPS outages utilizing ensemble learning algorithm , 2017, Inf. Fusion.

[35]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[36]  Samia Boukir,et al.  Margin-based ordered aggregation for ensemble pruning , 2013, Pattern Recognit. Lett..

[37]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[38]  Francisco Herrera,et al.  Ordering-based pruning for improving the performance of ensembles of classifiers in the framework of imbalanced datasets , 2016, Inf. Sci..

[39]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[40]  James Llinas,et al.  Handbook of Multisensor Data Fusion : Theory and Practice, Second Edition , 2008 .

[41]  Hongnian Yu,et al.  A practical multi-sensor activity recognition system for home-based care , 2014, Decis. Support Syst..

[42]  Mauro Iacono,et al.  Performance evaluation of NoSQL big-data applications using multi-formalism models , 2014, Future Gener. Comput. Syst..