Preprocessing techniques for context recognition from accelerometer data

The ubiquity of communication devices such as smartphones has led to the emergence of context-aware services that are able to respond to specific user activities or contexts. These services allow communication providers to develop new, added-value services for a wide range of applications such as social networking, elderly care and near-emergency early warning systems. At the core of these services is the ability to detect specific physical settings or the context a user is in, using either internal or external sensors. For example, using built-in accelerometers, it is possible to determine whether a user is walking or running at a specific time of day. By correlating this knowledge with GPS data, it is possible to provide specific information services to users with similar daily routines. This article presents a survey of the techniques for extracting this activity information from raw accelerometer data. The techniques that can be implemented in mobile devices range from classical signal processing techniques such as FFT to contemporary string-based methods. We present experimental results to compare and evaluate the accuracy of the various techniques using real data sets collected from daily activities.

[1]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[2]  Joyce Ho Interruptions : using activity transitions to trigger proactive messages , 2004 .

[3]  Lin Zhong,et al.  uWave: Accelerometer-based Personalized Gesture Rec- ognition , 2008 .

[4]  김형곤,et al.  ADL Classification Using Triaxial Accelerometers and RFID , 2007 .

[5]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[6]  Taesoo Lee,et al.  Context Awareness of Human Motion States Using Accelerometer , 2007, Journal of Medical Systems.

[7]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[8]  B. G. Celler,et al.  Classification of basic daily movements using a triaxial accelerometer , 2004, Medical and Biological Engineering and Computing.

[9]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[10]  Jani Mäntyjärvi,et al.  Sensor-based context recognition for mobile applications , 2003 .

[11]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[12]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[13]  P H Veltink,et al.  Detection of static and dynamic activities using uniaxial accelerometers. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  Ig-Jae Kim,et al.  Automatic ADL classification using 3-axial accelerometers and RFID sensor , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[15]  Y. Kawahara,et al.  Recognizing User Context Using Mobile Handsets with Acceleration Sensors , 2007, 2007 IEEE International Conference on Portable Information Devices.

[16]  Dan Gusfield,et al.  Algorithms on Strings, Trees, and Sequences - Computer Science and Computational Biology , 1997 .

[17]  Michael Beigl,et al.  A Wearable Context-Awareness Component , 1999 .

[18]  Klaus Winkelmann Conference on Innovative Applications of Artificial Intelligence , 1989, Künstliche Intell..

[19]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[20]  Albrecht Schmidt,et al.  A wearable context-awareness component. Finally a good reason to wear a tie , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[21]  Diogo R. Ferreira,et al.  Context Inference for Mobile Applications in the UPCASE Project , 2009, MOBILWARE.

[22]  Neal Lesh,et al.  Indoor navigation using a diverse set of cheap, wearable sensors , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[23]  Jennifer Healey,et al.  Wearable wellness monitoring using ECG and accelerometer data , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[24]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[25]  M. Akay,et al.  Discrimination of walking patterns using wavelet-based fractal analysis , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Wan-Young Chung,et al.  Classification of Posture and Movement Using a 3-axis Accelerometer , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[27]  Daniel Ashbrook Context Sensing with the Twiddler Keyboard , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[28]  David G. Renter,et al.  Evaluation of three-dimensional accelerometers to monitor and classify behavior patterns in cattle , 2009 .

[29]  R. Bajcsy,et al.  Wearable Sensors for Reliable Fall Detection , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[30]  Eric Monacelli,et al.  On-line Automatic Detection of Human Activity in Home Using Wavelet and Hidden Markov Models Scilab Toolkits , 2007, 2007 IEEE International Conference on Control Applications.

[31]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[32]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[33]  Waltenegus Dargie A distributed architecture for computing context in mobile devices , 2006 .

[34]  Gerhard Tröster,et al.  Gestures are strings: efficient online gesture spotting and classification using string matching , 2007, BODYNETS.

[35]  Kristof Van Laerhoven,et al.  Real-time analysis of data from many sensors with neural networks , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[36]  Eamonn J. Keogh,et al.  A symbolic representation of time series, with implications for streaming algorithms , 2003, DMKD '03.

[37]  J. D. Janssen,et al.  A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity , 1997, IEEE Transactions on Biomedical Engineering.

[38]  Emmanuel Munguia Tapia,et al.  Acquiring in situ training data for context-aware ubiquitous computing applications , 2004, CHI.

[39]  Albrecht Schmidt,et al.  Ubiquitous computing - computing in context , 2003 .

[40]  Albrecht Schmidt,et al.  Recognizing context for annotating a live life recording , 2007, Personal and Ubiquitous Computing.

[41]  Svetha Venkatesh,et al.  Hierarchical recognition of intentional human gestures for sports video annotation , 2002, Object recognition supported by user interaction for service robots.

[42]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[43]  Byeong-Tae Anh Event Semantic Photo Retrieval Management System Based on MPEG-7 , 2007 .

[44]  W. Martens,et al.  The fast time frequency transform (F.T.F.T.): A novel on-line approach to the instantaneous spectrum , 1992, 1992 14th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Kamiar Aminian,et al.  Estimation of speed and incline of walking using neural network , 1994 .

[46]  Joaquim A. Jorge,et al.  Mnemonical body shortcuts: improving mobile interaction , 2008, ECCE '08.

[47]  S. Mallat A wavelet tour of signal processing , 1998 .

[48]  Yoshihiro Kawahara,et al.  Monitoring Daily Energy Expenditure using a 3-Axis Accelerometer with a Low-Power Microprocessor , 2009, e Minds Int. J. Hum. Comput. Interact..

[49]  Garrett R. Brown,et al.  An Accelerometer Based Fall Detector : Development , Experimentation , and Analysis , 2005 .

[50]  K. Aminian,et al.  Physical activity monitoring based on accelerometry: validation and comparison with video observation , 1999, Medical & Biological Engineering & Computing.

[51]  Kristof Van Laerhoven,et al.  What shall we teach our pants? , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[52]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[53]  Andreas Krause,et al.  SenSay: a context-aware mobile phone , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[54]  M. Nambu Body Surface Mounted Biomedical Monitoring System using Bluetooth , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  Matthai Philipose,et al.  Common Sense Based Joint Training of Human Activity Recognizers , 2007, IJCAI.

[56]  Serena Yeung,et al.  Predicting Mode of Transport from iPhone Accelerometer Data , 2012 .

[57]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[58]  P. Caselli,et al.  Classification of Motor Activities through Derivative Dynamic Time Warping applied on Accelerometer Data , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[59]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[60]  T. Tamura,et al.  Classification of walking pattern using acceleration waveform in elderly people , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[61]  Gaetano Borriello,et al.  Mobile Context Inference Using Low-Cost Sensors , 2005, LoCA.

[62]  Manuela Veloso,et al.  Learning from accelerometer data on a legged robot , 2004 .

[63]  Li Wei,et al.  Compression-based data mining of sequential data , 2007, Data Mining and Knowledge Discovery.

[64]  Andreas Krause,et al.  Unsupervised, dynamic identification of physiological and activity context in wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[65]  Toshiyo Tamura,et al.  Classification of acceleration waveform in a continuous walking record , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[66]  Dan Gusfield,et al.  Algorithms on Strings, Trees, and Sequences - Computer Science and Computational Biology , 1997 .

[67]  Kristof Van Laerhoven,et al.  How to build smart appliances? , 2001, IEEE Personal Communications.