Semantic Activity Classification Using Locomotive Signatures from Mobile Phones

We explore the use of mobile phone-generated sensor feeds to determine the high-level (i.e., at the semantic level), indoor, lifestyle activities of individuals, such as cooking & dining at home and working & having lunch at the work- place. We propose and evaluate a 2-Tier activity extraction framework (called SAMMPLE1) where features of the low-level accelerometer data are first used to identify individual locomotive micro-activities (e.g., sitting or standing), and the micro-activity sequence is subsequently used to identify the discriminatory characteristics of individual semantic activities. Using 152 days of real-life behavioral traces from users, our approach achieves an average accuracy of 77.14%, an improvement of 16.37% from the traditional 1-Tier approach, which directly uses statistical features of the accelerometer stream, towards such activity classification tasks.

[1]  Daniel Gatica-Perez,et al.  GroupUs: Smartphone Proximity Data and Human Interaction Type Mining , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[2]  Svetha Venkatesh,et al.  Learning Discriminative Sequence Models from Partially Labelled Data for Activity Recognition , 2008, PRICAI.

[3]  Yi Wang,et al.  A framework of energy efficient mobile sensing for automatic user state recognition , 2009, MobiSys '09.

[4]  Stefano Spaccapietra,et al.  SeMiTri: a framework for semantic annotation of heterogeneous trajectories , 2011, EDBT/ICDT '11.

[5]  Jiawei Han,et al.  Discriminative Frequent Pattern Analysis for Effective Classification , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[6]  Wei Pan,et al.  SoundSense: scalable sound sensing for people-centric applications on mobile phones , 2009, MobiSys '09.

[7]  Xing Xie,et al.  Collaborative location and activity recommendations with GPS history data , 2010, WWW '10.

[8]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[9]  Emmanuel,et al.  Activity recognition in the home setting using simple and ubiquitous sensors , 2003 .

[10]  Naranker Dulay,et al.  Predicting human behaviour from selected mobile phone data points , 2010, UbiComp.

[11]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[12]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[13]  Bernt Schiele,et al.  Context-aware notification for wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[14]  Yi-Ting Chiang,et al.  Continuous Recognition of Daily Activities from Multiple Heterogeneous Sensors , 2009, AAAI Spring Symposium: Human Behavior Modeling.

[15]  L. A. Smith,et al.  Feature Subset Selection: A Correlation Based Filter Approach , 1997, ICONIP.

[16]  Jun Yang,et al.  Physical Activity Recognition with Mobile Phones: Challenges, Methods, and Applications , 2010 .

[17]  Christian S. Jensen,et al.  Mining significant semantic locations from GPS data , 2010, Proc. VLDB Endow..

[18]  Gernot Bahle,et al.  What Can an Arm Holster Worn Smart Phone Do for Activity Recognition? , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[19]  Juan-Luis Gorricho,et al.  Activity Recognition from Accelerometer Data on a Mobile Phone , 2009, IWANN.

[20]  Mirco Musolesi,et al.  The Rise of People-Centric Sensing , 2008, IEEE Internet Comput..

[21]  Jennifer Healey,et al.  Wearable wellness monitoring using ECG and accelerometer data , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[22]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[23]  Xing Xie,et al.  Mining interesting locations and travel sequences from GPS trajectories , 2009, WWW '09.

[24]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[25]  Zhigang Liu,et al.  The Jigsaw continuous sensing engine for mobile phone applications , 2010, SenSys '10.

[26]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[27]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.