Multisensor Fusion in Smartphones for Lifestyle Monitoring

Smartphones with diverse sensing capabilities are becoming widely available and pervasive in use. With the phone becoming a mobile personal computer, integrated applications can use multi-sensory data to derive information about the user's actions and the context in which these actions occur. This paper develops a novel method to assess daily living patterns using a smartphone equipped with microphones and inertial sensors. We develop a feature-space combination approach for fusion of information from sensors sampled at different rates and present a computationally light-weight algorithm to identify various high level activities. Preliminary results from an initial deployment among eight users indicate the potential for accurate, context-aware, and personalized sensing.

[1]  N. Christakis,et al.  The Spread of Obesity in a Large Social Network Over 32 Years , 2007, The New England journal of medicine.

[2]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[3]  Andreas Krause,et al.  SenSay: a context-aware mobile phone , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[4]  Ahmed H. Tewfik,et al.  A feature combination approach for the detection of early morning bathroom activities with wireless sensors , 2007, HealthNet '07.

[5]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[6]  Tarek F. Abdelzaher,et al.  SATIRE: a software architecture for smart AtTIRE , 2006, MobiSys '06.

[7]  Romit Roy Choudhury,et al.  AAMPL: accelerometer augmented mobile phone localization , 2008, MELT '08.

[8]  Mark J. F. Gales,et al.  Iterative unsupervised adaptation using maximum likelihood linear regression , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[9]  T. Stratton,et al.  Health Behavior in Persons Living with Chronic Conditions , 1997 .

[10]  Gaetano Borriello,et al.  BALANCE: towards a usable pervasive wellness application with accurate activity inference , 2009, HotMobile '09.

[11]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[12]  Huiru Zheng,et al.  Human Activity Detection in Smart Home Environment with Self-Adaptive Neural Networks , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[13]  Roy Want,et al.  You Are Your Cell Phone , 2008, IEEE Pervasive Computing.

[14]  James Fogarty,et al.  iLearn on the iPhone: Real-Time Human Activity Classification on Commodity Mobile Phones , 2008 .

[15]  Bernt Schiele,et al.  ADL recognition based on the combination of RFID and accelerometer sensing , 2008, 2008 Second International Conference on Pervasive Computing Technologies for Healthcare.

[16]  B. Logan,et al.  Sensors to Detect the Activities of Daily Living , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Ishwar K. Sethi,et al.  Classification of general audio data for content-based retrieval , 2001, Pattern Recognit. Lett..