Limited-Memory Warping LCSS for Real-Time Low-Power Pattern Recognition in Wireless Nodes

We present and evaluate a microcontroller-optimized limited-memory implementation of a Warping Longest Common Subsequence algorithm (WarpingLCSS). It permits to spot patterns within noisy sensor data in real-time in resource constrained sensor nodes. It allows variability in the sensed system dynamics through warping; it uses only integer operations; it can be applied to various sensor modalities; and it is suitable for embedded training to recognize new patterns. We illustrate the method on 3 applications from wearable sensing and activity recognition using 3 sensor modalities: spotting the QRS complex in ECG, recognizing gestures in everyday life, and analyzing beach volleyball. We implemented the system on a low-power 8-bit AVR wireless node and a 32-bit ARM Cortex M4 microcontroller. Up to 67 or 140 10-second gestures can be recognized simultaneously in real-time from a 10Hz motion sensor on the AVR and M4 using 8mW and 10mW respectively. A single gesture spotter uses as few as 135μW on the AVR. The method allows low data rate distributed in-network recognition and we show a 100 fold data rate reduction in a complex activity recognition scenario. The versatility and low complexity of the method makes it well suited as a generic pattern recognition method and could be implemented as part of sensor front-ends.

[1]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[2]  Daniel A. Keim,et al.  On Knowledge Discovery and Data Mining , 1997 .

[3]  Uwe Hansmann,et al.  Pervasive Computing , 2003 .

[4]  Paul Lukowicz,et al.  SoundButton: design of a low power wearable audio classification system , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[5]  Dimitrios Gunopulos,et al.  Indexing Multidimensional Time-Series , 2004, The VLDB Journal.

[6]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[7]  James Demmel,et al.  Health Monitoring of Civil Infrastructures Using Wireless Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[8]  Peter I. Corke,et al.  Transforming Agriculture through Pervasive Wireless Sensor Networks , 2007, IEEE Pervasive Computing.

[9]  Paul J. M. Havinga,et al.  Distributed Activity Recognition with Fuzzy-Enabled Wireless Sensor Networks , 2007, DCOSS.

[10]  Paul Lukowicz,et al.  Dealing with sensor displacement in motion-based onbody activity recognition systems , 2008, UbiComp.

[11]  Biswanath Mukherjee,et al.  Wireless sensor network survey , 2008, Comput. Networks.

[12]  Diane J. Cook,et al.  Keeping the Resident in the Loop: Adapting the Smart Home to the User , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Luca Benini,et al.  Hidden Markov Models Implementation for Tangible Interfaces , 2009, INTETAIN.

[14]  Juan Carlos Augusto,et al.  Editorial: Inaugural issue , 2009, J. Ambient Intell. Smart Environ..

[15]  Allen Y. Yang,et al.  Distributed recognition of human actions using wearable motion sensor networks , 2009, J. Ambient Intell. Smart Environ..

[16]  Nirvana Meratnia,et al.  Sensor fusion-based event detection in Wireless Sensor Networks , 2009, 2009 6th Annual International Mobile and Ubiquitous Systems: Networking & Services, MobiQuitous.

[17]  Fabio Bellifemine,et al.  SPINE2: developing BSN applications on heterogeneous sensor nodes , 2009, 2009 IEEE International Symposium on Industrial Embedded Systems.

[18]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[19]  Patrick Olivier,et al.  A Dynamic Time Warping Approach to Real-Time Activity Recognition for Food Preparation , 2010, AmI.

[20]  Lars Widmer,et al.  An Educational and Research Kit for Activity and Context Recognition from On-body Sensors , 2010, 2010 International Conference on Body Sensor Networks.

[21]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[22]  B. Buscà,et al.  The influence of serve characteristics on performance in men's and women's high-standard beach volleyball , 2012, Journal of sports sciences.

[23]  Luca Benini,et al.  Network-Level Power-Performance Trade-Off in Wearable Activity Recognition: A Dynamic Sensor Selection Approach , 2012, TECS.

[24]  Alberto Calatroni,et al.  Improving online gesture recognition with template matching methods in accelerometer data , 2012, 2012 12th International Conference on Intelligent Systems Design and Applications (ISDA).

[25]  Reza Lotfian,et al.  Impact of sensor misplacement on dynamic time warping based human activity recognition using wearable computers , 2012, Wireless Health.

[26]  Ricardo Chavarriaga,et al.  The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition , 2013, Pattern Recognit. Lett..

[27]  Ricardo Chavarriaga,et al.  On-line anomaly detection and resilience in classifier ensembles , 2013, Pattern Recognit. Lett..

[28]  Wen Hu,et al.  Real-time classification via sparse representation in acoustic sensor networks , 2013, SenSys '13.

[29]  Alberto Calatroni,et al.  Robust online gesture recognition with crowdsourced annotations , 2014, J. Mach. Learn. Res..

[30]  Martin Vetterli,et al.  DASS: Distributed Adaptive Sparse Sensing , 2013, IEEE Transactions on Wireless Communications.