Robust Sparse Representation-Based Classification Using Online Sensor Data for Monitoring Manual Material Handling Tasks

Sensor-based online process monitoring has extensive applications, such as in manufacturing and service industries. In real environments, though, sensor data are often contaminated with noise, leading to severe challenges in accurate data analysis. In the existing literature, noise is generally modeled as Gaussian to analyze sensor data for various applications, for example in fault detection and diagnostics. However, in some applications, such as due to challenging field conditions, sensor data may be disturbed by high levels of outliers such that the Gaussian assumption of sensor noise is inadequate, thus leading to large estimation errors. This paper focuses on online classification applications. A robust sparse representation classification method is proposed, which considers non-Gaussian noise, and thus can effectively analyze sensor data with higher levels of outliers. Case studies were completed, based on both numerically simulated sensor data and actual wearable sensor data from occupational manual material handling process monitoring. The proposed classification method could effectively analyze sensor data with non-Gaussian noise, and outperformed commonly used methods in the literature. Thus, this new method may be advantageous for solving classification problems in challenging field conditions, to address the difficulties of high levels of sensor outliers.Note to Practitioners—This paper proposes a fast, robust classification method for online sensor data classification. The proposed method is designed to cope with high levels of sensor outliers. The robustness of the method and its computational efficiency make it particularly appealing for online sensor data classification in challenging field conditions in which the presence of sensor outliers causes practical difficulties for most existing classification algorithms.

[1]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Mahdi Boloursaz,et al.  Bounds on compressed voice channel capacity , 2014, 2014 Iran Workshop on Communication and Information Theory (IWCIT).

[3]  Hongxing He,et al.  A comparative study of RNN for outlier detection in data mining , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[4]  Yonina C. Eldar,et al.  Near-Oracle Performance of Greedy Block-Sparse Estimation Techniques From Noisy Measurements , 2010, IEEE Journal of Selected Topics in Signal Processing.

[5]  Kenneth E. Barner,et al.  Lorentzian based iterative hard thresholding for compressed sensing , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[7]  Mahbub Hassan,et al.  KEH-Gait: Towards a Mobile Healthcare User Authentication System by Kinetic Energy Harvesting , 2017, NDSS.

[8]  Neil W. Bergmann,et al.  Sensor-Assisted Face Recognition System on Smart Glass via Multi-View Sparse Representation Classification , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[9]  Irina Rish,et al.  An empirical study of the naive Bayes classifier , 2001 .

[10]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[11]  Sunwook Kim,et al.  An evaluation of classification algorithms for manual material handling tasks based on data obtained using wearable technologies , 2014, Ergonomics.

[12]  Zhenyu Kong,et al.  An online sparse estimation-based classification approach for real-time monitoring in advanced manufacturing processes from heterogeneous sensor data , 2016 .

[13]  David S. Johnson,et al.  Support Vector Machines for Classification , 2022 .

[14]  A Mital Analysis of multiple activity manual materials handling tasks using A Guide to Manual Materials Handling. , 1999, Ergonomics.

[15]  William W. Hager,et al.  A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization , 2004, SIAM J. Optim..

[16]  Shengli Zhou,et al.  Application of compressive sensing to sparse channel estimation , 2010, IEEE Communications Magazine.

[17]  Maury A. Nussbaum,et al.  Online Classification and Sensor Selection Optimization With Applications to Human Material Handling Tasks Using Wearable Sensing Technologies , 2016, IEEE Transactions on Human-Machine Systems.

[18]  Zhi-Hua Zhou,et al.  A k-nearest neighbor based algorithm for multi-label classification , 2005, 2005 IEEE International Conference on Granular Computing.

[19]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[20]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[21]  S. Mathiassen,et al.  On the evolution of task-based analysis of manual materials handling, and its applicability in contemporary ergonomics. , 2006, Applied ergonomics.

[22]  Balas K. Natarajan,et al.  Sparse Approximate Solutions to Linear Systems , 1995, SIAM J. Comput..

[23]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[24]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[25]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[26]  Kenneth E. Barner,et al.  Robust Sampling and Reconstruction Methods for Sparse Signals in the Presence of Impulsive Noise , 2010, IEEE Journal of Selected Topics in Signal Processing.

[27]  A Yassi,et al.  Work-related musculoskeletal disorders , 2000, Current opinion in rheumatology.

[28]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[29]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[30]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[31]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[32]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[33]  John H. L. Hansen,et al.  Feature analysis and neural network-based classification of speech under stress , 1996, IEEE Trans. Speech Audio Process..

[34]  Mike E. Davies,et al.  Normalized Iterative Hard Thresholding: Guaranteed Stability and Performance , 2010, IEEE Journal of Selected Topics in Signal Processing.

[35]  Jia Liu,et al.  Online Real-Time Quality Monitoring in Additive Manufacturing Processes Using Heterogeneous Sensors , 2015 .

[36]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .

[37]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[38]  Nojun Kwak,et al.  Principal Component Analysis Based on L1-Norm Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Håkan Hjalmarsson,et al.  Sparse estimation based on a validation criterion , 2011, IEEE Conference on Decision and Control and European Control Conference.

[40]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[41]  Bhaskar D. Rao,et al.  Sparse channel estimation via matching pursuit with application to equalization , 2002, IEEE Trans. Commun..

[42]  Thia Kirubarajan,et al.  Robust sparse channel estimation and equalization in impulsive noise using linear programming , 2013, Signal Process..

[43]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[44]  Desire L. Massart,et al.  Comparison of regularized discriminant analysis linear discriminant analysis and quadratic discriminant analysis applied to NIR data , 1996 .

[45]  M. M. Ayoub,et al.  Problems and solutions in manual materials handling: the state of the art , 1992 .

[46]  Irad Ben-Gal Outlier Detection , 2005, The Data Mining and Knowledge Discovery Handbook.

[47]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[48]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[49]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[50]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[51]  P. Dempsey,et al.  A critical review of biomechanical, epidemiological, physiological and psychophysical criteria for designing manual materials handling tasks. , 1998, Ergonomics.

[52]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[53]  Harry Zhang,et al.  The Optimality of Naive Bayes , 2004, FLAIRS.

[54]  A. Tsybakov,et al.  Sparse Estimation by Exponential Weighting , 2011, 1108.5116.

[55]  A Freivalds,et al.  Multiple criteria decision-making for the resolution of conflicting ergonomic knowledge in manual materials handling. , 1991, Ergonomics.