Realtime Recognition of Complex Human Daily Activities Using Human Motion and Location Data

Daily activity recognition is very useful in robot-assisted living systems. In this paper, we proposed a method to recognize complex human daily activities which consist of simultaneous body activities and hand gestures in an indoor environment. A wireless power-aware motion sensor node is developed which consists of a commercial orientation sensor, a wireless communication module, and a power management unit. To recognize complex daily activities, three motion sensor nodes are attached to the right thigh, the waist, and the right hand of a human subject, while an optical motion capture system is used to obtain his/her location information. A three-level dynamic Bayesian network (DBN) is implemented to model the intratemporal and intertemporal constraints among the location, body activity, and hand gesture. The body activity and hand gesture are estimated using a Bayesian filter and a short-time Viterbi algorithm, which reduces the computational complexity and memory usage. We conducted experiments in a mock apartment environment and the obtained results showed the effectiveness and accuracy of our method.

[1]  E. Bongers,et al.  Miniature Wireless Inertial Sensor for Measuring Human Motions , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[3]  Andreas Savvides,et al.  The BehaviorScope framework for enabling ambient assisted living , 2010, Personal and Ubiquitous Computing.

[4]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[5]  Jeff A. Bilmes,et al.  Rao-Blackwellized Particle Filters for Recognizing Activities and Spatial Context from Wearable Sensors , 2006, ISER.

[6]  Christopher G. Atkeson,et al.  Simultaneous Tracking and Activity Recognition (STAR) Using Many Anonymous, Binary Sensors , 2005, Pervasive.

[7]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[8]  Malcolm J. Joyce,et al.  Wireless inertial sensor for tumour motion tracking , 2007 .

[9]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[10]  Xavier Rodet,et al.  Short-time Viterbi for online HMM decoding: Evaluation on a real-time phone recognition task , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  William C. Mann,et al.  Smart Technology for Aging, Disability and Independence: The State of the Science , 2005 .

[12]  Zoubin Ghahramani,et al.  Learning Dynamic Bayesian Networks , 1997, Summer School on Neural Networks.

[13]  Shuangquan Wang,et al.  Wearable accelerometer based extendable activity recognition system , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Xi Long,et al.  Single-accelerometer-based daily physical activity classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Z. Khalil,et al.  Effects of aging on neurogenic vasodilator responses evoked by transcutaneous electrical nerve stimulation: relevance to wound healing. , 2000, The journals of gerontology. Series A, Biological sciences and medical sciences.

[16]  Bernt Schiele,et al.  Scalable Recognition of Daily Activities with Wearable Sensors , 2007, LoCA.