Dealing with sensor displacement in motion-based onbody activity recognition systems

We present a set of heuristics that significantly increase the robustness of motion sensor-based activity recognition with respect to sensor displacement. In this paper placement refers to the position within a single body part (e.g, lower arm). We show how, within certain limits and with modest quality degradation, motion sensorbased activity recognition can be implemented in a displacement tolerant way. We first describe the physical principles that lead to our heuristic. We then evaluate them first on a set of synthetic lower arm motions which are well suited to illustrate the strengths and limits of our approach, then on an extended modes of locomotion problem (sensors on the upper leg) and finally on a set of exercises performed on various gym machines (sensors placed on the lower arm). In this example our heuristic raises the displaced recognition rate from 24% for a displaced accelerometer, which had 96% recognition when not displaced, to 82%.

[1]  Andreas Krause,et al.  Context-aware mobile computing: learning context- dependent personal preferences from a wearable sensor array , 2006, IEEE Transactions on Mobile Computing.

[2]  Paul Lukowicz,et al.  Where am I: Recognizing On-body Positions of Wearable Sensors , 2005, LoCA.

[3]  P. Lukowicz,et al.  From Sensors to Miniature Networked SensorButtons , 2006 .

[4]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[5]  Kristof Van Laerhoven,et al.  Spine versus porcupine: a study in distributed wearable activity recognition , 2004, Eighth International Symposium on Wearable Computers.

[6]  Joan Truckenbrod IEEE international symposium on wearable computers , 1998, COMG.

[7]  Paul Lukowicz,et al.  Wearable Sensing to Annotate Meeting Recordings , 2002, SEMWEB.

[8]  Gregory D. Abowd,et al.  Recognizing mimicked autistic self-stimulatory behaviors using HMMs , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[9]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[10]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[11]  Bernt Schiele,et al.  Toward Recognition of Short and Non-repetitive Activities from Wearable Sensors , 2007, AmI.

[12]  David W. Mizell,et al.  Using gravity to estimate accelerometer orientation , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[13]  Kristof Van Laerhoven,et al.  Memorizing What You Did Last Week: Towards Detailed Actigraphy With A Wearable Sensor , 2007, 27th International Conference on Distributed Computing Systems Workshops (ICDCSW'07).

[14]  Blake Hannaford,et al.  "Are You with Me?" - Using Accelerometers to Determine If Two Devices Are Carried by the Same Person , 2004, Pervasive.

[15]  Tapio Seppänen,et al.  Recognizing human motion with multiple acceleration sensors , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[16]  Paul Lukowicz,et al.  Using multiple sensors for mobile sign language recognition , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[17]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[18]  Joseph A. Paradiso,et al.  Sensemble: A Wireless, Compact, Multi-User Sensor System for Interactive Dance , 2006, NIME.

[19]  Paul Lukowicz,et al.  Wearable Activity Tracking in Car Manufacturing , 2008, IEEE Pervasive Computing.