Improving activity recognition without sensor data: a comparison study of time use surveys

Wearable sensing systems, through their proximity with their user, can be used to automatically infer the wearer's activity to obtain detailed information on availability, behavioural patterns and health. For this purpose, classifiers need to be designed and evaluated with sufficient training data from these sensors and from a representative set of users, which requires starting this procedure from scratch for every new sensing system and set of activities. To alleviate this procedure and optimize classification performance, the use of time use surveys has been suggested: These large databases contain typically several days worth of detailed activity information from a large population of hundreds of thousands of participants. This paper uses a strategy first suggested by [16] that utilizes time use diaries in an activity recognition method. We offer a comparison of the aforementioned North-American data with a large European database, showing that although there are several cultural differences, certain important features are shared between both regions. By cross-validating across the 5160 households in this new data with activity episodes of 13798 individuals, especially distinctive features turn out to be time and participant's location. Additionally, we identify for 11 different activities which features are most suited to be used for later on activity recognition.

[1]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  John A. Quinn,et al.  Methodologies for Continuous Cellular Tower Data Analysis , 2009, Pervasive.

[3]  Kristof Van Laerhoven,et al.  Combining wearable and environmental sensing into an unobtrusive tool for long-term sleep studies , 2012, IHI '12.

[4]  Matthias Budde,et al.  ActiServ: Activity Recognition Service for mobile phones , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[5]  Philippe Golle,et al.  On using existing time-use study data for ubiquitous computing applications , 2008, UbiComp.

[6]  Thad Starner,et al.  Using GPS to learn significant locations and predict movement across multiple users , 2003, Personal and Ubiquitous Computing.

[7]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[8]  Bernt Schiele,et al.  Using rhythm awareness in long-term activity recognition , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[9]  K. Shelley Developing the American Time Use Survey activity classification system , 2005 .

[10]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[11]  G. Jean-Louis,et al.  Sleep estimation from wrist movement quantified by different actigraphic modalities , 2001, Journal of Neuroscience Methods.

[12]  Daniel Gatica-Perez,et al.  GroupUs: Smartphone Proximity Data and Human Interaction Type Mining , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[13]  Luciane L. de Souza,et al.  Further validation of actigraphy for sleep studies. , 2003, Sleep.

[14]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[15]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[16]  Alex Pentland,et al.  Reality mining: sensing complex social systems , 2006, Personal and Ubiquitous Computing.

[17]  Daniel Gatica-Perez,et al.  What did you do today?: discovering daily routines from large-scale mobile data , 2008, ACM Multimedia.

[18]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[19]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[20]  Matthias Struck,et al.  User-friendly system for recognition of activities with an accelerometer , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[21]  Takuya Maekawa,et al.  Unsupervised Activity Recognition with User's Physical Characteristics Data , 2011, 2011 15th Annual International Symposium on Wearable Computers.