Distributed segmentation and classification of human actions using a wearable motion sensor network

We propose a distributed recognition method to classify human actions using a low-bandwidth wearable motion sensor network. Given a set of pre-segmented motion sequences as training examples, the algorithm simultaneously segments and classifies human actions, and it also rejects outlying actions that are not in the training set. The classification is distributedly operated on individual sensor nodes and a base station computer. We show that the distribution of multiple action classes satisfies a mixture subspace model, one sub-space for each action class. Given a new test sample, we seek the sparsest linear representation of the sample w.r.t. all training examples. We show that the dominant coefficients in the representation only correspond to the action class of the test sample, and hence its membership is encoded in the representation. We further provide fast linear solvers to compute such representation via l1-minimization. Using up to eight body sensors, the algorithm achieves state-of-the-art 98.8% accuracy on a set of 12 action categories. We further demonstrate that the recognition precision only decreases gracefully using smaller subsets of sensors, which validates the robustness of the distributed framework.

[1]  E.J. Candes Compressive Sampling , 2022 .

[2]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[3]  Allen Y. Yang,et al.  Feature Selection in Face Recognition: A Sparse Representation Perspective , 2007 .

[4]  Michael Elad,et al.  On the stability of the basis pursuit in the presence of noise , 2006, Signal Process..

[5]  Pieter D. Biemond,et al.  Wearable Sensor Badge & Sensor Jacket for Context Awareness , 1999 .

[6]  Tatsuo Nakajima,et al.  Feature Selection and Activity Recognition from Wearable Sensors , 2006, UCS.

[7]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[8]  Jeffrey P. Morrill Distributed recognition of patterns in time series data , 1998, CACM.

[9]  H. Kemper,et al.  Validity and reliability of pedometers in habitual activity research , 1977, European Journal of Applied Physiology and Occupational Physiology.

[10]  Hamid Aghajan,et al.  Collaborative Face Orientation Detection in Wireless Image Sensor Networks , 2006 .

[11]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[12]  Bernhard Rinner,et al.  Vehicle Classification on Multi-Sensor Smart Cameras Using Feature- and Decision-Fusion , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[13]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[14]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[15]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[16]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  J.A. Paradiso,et al.  A Compact, High-Speed, Wearable Sensor Network for Biomotion Capture and Interactive Media , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[18]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[19]  Paul Lukowicz,et al.  Experimental Evaluation of Variations in Primary Features Used for Accelerometric Context Recognition , 2003, EUSAI.

[20]  Margaret Martonosi,et al.  Data compression algorithms for energy-constrained devices in delay tolerant networks , 2006, SenSys '06.

[21]  David L. Donoho,et al.  Neighborly Polytopes And Sparse Solution Of Underdetermined Linear Equations , 2005 .

[22]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[23]  Joseph A. Paradiso,et al.  Groggy Wakeup - Automated Generation of Power-Efficient Detection Hierarchies for Wearable Sensors , 2007, BSN.

[24]  Liang He,et al.  The study on distributed speech recognition system , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).