Real world activity summary for senior home monitoring

From a senior person's daily activities, one can tell a lot about the health condition of the senior person. Thus we believe that senior home activity analysis will play an important role in the health care of senior people. Toward this goal, we propose a senior home activity summary system. One challenging problem in such a real world application is that senior's activities are usually accompanied by nurse's walking. It is impractical to predefine and label all the potential activities of all the potential visitors. To address this problem, we propose a novel feature filtering technique to reduce or eliminate the effects of the interest points that belong to other people. To evaluate the proposed activity summary system, we have collected a senior home activity dataset (SAR), and performed activity recognition for eating and walking classes. The experimental results show that the proposed system provides quite accurate activity summaries for a real world application scenario.

[1]  Priya Narasimhan,et al.  TwitterJacket: An Automated Activity and Health Monitoring Solution for the Elderly (CMU-CyLab-10-003) , 2009 .

[2]  Véronique Prinet,et al.  Towards Optimal Naive Bayes Nearest Neighbor , 2010, ECCV.

[3]  J. B. J. Bussmann,et al.  Measuring daily behavior using ambulatory accelerometry: The Activity Monitor , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[4]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[5]  Martin F. Krafft,et al.  Design Aspects for Elderly Using a Health Smart Home , 2009 .

[6]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Bingbing Ni,et al.  RGBD-HuDaAct: A color-depth video database for human daily activity recognition , 2011, ICCV Workshops.

[8]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[9]  Christopher Joseph Pal,et al.  Activity recognition using the velocity histories of tracked keypoints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[11]  Ivan Laptev,et al.  On Space-Time Interest Points , 2005, International Journal of Computer Vision.

[12]  Jiebo Luo,et al.  Recognizing realistic actions from videos , 2009, CVPR.

[13]  Adriana Kovashka,et al.  Learning a hierarchy of discriminative space-time neighborhood features for human action recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, ICPR 2004.

[16]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Norbert Noury,et al.  Telemonitoring of patients at home: a software agent approach , 2003, Comput. Methods Programs Biomed..

[19]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[21]  Ying Wu,et al.  Discriminative subvolume search for efficient action detection , 2009, CVPR.

[22]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2008, International Journal of Computer Vision.

[23]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[24]  Zicheng Liu,et al.  Cross-dataset action detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Hajime Murai,et al.  Life with a Robot Companion: Video Analysis of 16-Days of Interaction with a Home Robot in a "Ubiquitous Home" Environment , 2009, HCI.

[27]  Mohan S. Kankanhalli,et al.  Information assimilation framework for event detection in multimedia surveillance systems , 2006, Multimedia Systems.

[28]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Sharath Pankanti,et al.  Biometric Recognition: Security and Privacy Concerns , 2003, IEEE Secur. Priv..

[30]  Junsong Yuan,et al.  TechWare: Video-Based Human Action Detection Resources [Best of the Web] , 2010, IEEE Signal Processing Magazine.

[31]  Tao Gu,et al.  Object relevance weight pattern mining for activity recognition and segmentation , 2010, Pervasive Mob. Comput..

[32]  Bernt Schiele,et al.  A database for fine grained activity detection of cooking activities , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[34]  Paul Lukowicz,et al.  Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2006, BMVC.

[36]  M. Noshiro,et al.  An algorithm for the automatic detection of health conditions , 2005, IEEE Engineering in Medicine and Biology Magazine.

[37]  Ivor W. Tsang,et al.  Visual Event Recognition in Videos by Learning from Web Data , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Israel Gannot,et al.  Fall detection of elderly through floor vibrations and sound , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Denis Pellerin,et al.  A Temporal Belief Filter Improving Human Action Recognition in Videos , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[40]  Qiang Yang,et al.  Real world activity recognition with multiple goals , 2008, UbiComp.

[41]  Ying Wu,et al.  Speeding up spatio-temporal sliding-window search for efficient event detection in crowded videos , 2009, EiMM '09.

[42]  Martial Hebert,et al.  Event Detection in Crowded Videos , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[43]  Mirco Musolesi,et al.  Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application , 2008, SenSys '08.

[44]  Deva Ramanan,et al.  Detecting activities of daily living in first-person camera views , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[46]  Jian Lu,et al.  An unsupervised approach to activity recognition and segmentation based on object-use fingerprints , 2010, Data Knowl. Eng..

[47]  Yihong Gong,et al.  Action detection in complex scenes with spatial and temporal ambiguities , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[48]  James M. Rehg,et al.  Quasi-periodic event analysis for social game retrieval , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[49]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[50]  Dieter Fox,et al.  Location-Based Activity Recognition , 2005, KI.

[51]  David W. McDonald,et al.  Activity sensing in the wild: a field trial of ubifit garden , 2008, CHI.