Video-based activity level recognition for assisted living using motion features

Activities of daily living of the elderly is often monitored using passive sensor networks. With the reduction of camera prices, there is a growing interest of video-based approaches to provide a smart, safe and independent living environment for the elderly. In this paper, activity level in context of tracking the movement pattern of an individual as a metric to monitor the daily living of the elderly is explored. Activity levels can be an effective indicator that would denote the amount of busyness of an individual by modelling motion features over time. The novel framework uses two different variants of the motion features captured from two camera angles and classifies them into different activity levels using neural networks. A new dataset for assisted living research called the Sheffield Activities of Daily Living (SADL) dataset is used where each activity is simulated by 6 subjects and is captured under two different illumination conditions within a simulated assisted living environment. The experiments show that the overall detection rate using a single camera setup and a dual camera setup is above 80%.

[1]  M. Clarke,et al.  Monitoring activities of daily living of the elderly and the potential for its use in telecare and telehealth: a review. , 2013, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[2]  Linda Boise,et al.  Willingness of older adults to share data and privacy concerns after exposure to unobtrusive in-home monitoring. , 2013, Gerontechnology : international journal on the fundamental aspects of technology to serve the ageing society.

[3]  Peter T. Katzmarzyk,et al.  Physical Activity, Sedentary Behavior, and Health: Paradigm Paralysis or Paradigm Shift? , 2010, Diabetes.

[4]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[6]  Steve Brown,et al.  Modelling the Behaviour of Elderly People as a Means of Monitoring Well Being , 2005, User Modeling.

[7]  Fabien Cardinaux,et al.  Video based technology for ambient assisted living: A review of the literature , 2011, J. Ambient Intell. Smart Environ..

[8]  Frank Bomarius,et al.  An Event-Driven Approach to Activity Recognition in Ambient Assisted Living , 2009, AmI.

[9]  Guang-Zhong Yang,et al.  Real-Time Activity Classification Using Ambient and Wearable Sensors , 2009, IEEE Transactions on Information Technology in Biomedicine.

[10]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[11]  Bernt Schiele,et al.  A database for fine grained activity detection of cooking activities , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[13]  Hong Cheng,et al.  Real world activity summary for senior home monitoring , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[14]  Simon Brownsell,et al.  An evaluation of second and third generation telecare services in older people's housing , 2008, Journal of telemedicine and telecare.

[15]  Meng Wang,et al.  3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks , 2014, ACM Multimedia.

[16]  Christopher Joseph Pal,et al.  Activity recognition using the velocity histories of tracked keypoints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  J V Tu,et al.  Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. , 1996, Journal of clinical epidemiology.

[18]  Gregory D. Hager,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, CVPR.

[19]  Ying Wu,et al.  Mining actionlet ensemble for action recognition with depth cameras , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  E. D. Ilsar,et al.  Remote monitoring of health status of the elderly at home. A multidisciplinary project on aging at the University of New South Wales. , 1995, International journal of bio-medical computing.

[21]  Jozsef Suto,et al.  Human activity recognition using neural networks , 2014, Proceedings of the 2014 15th International Carpathian Control Conference (ICCC).

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).