Understanding of human behaviors from videos in nursing care monitoring systems

This paper addresses the issue in scenario-based understanding of human behavior from videos in a nursing care monitoring system. The analysis is carried out based on experiments consisting of single-state scenarios and multi-state scenarios where the former monitors activities under contextual contexts for elementary behavior reasoning, while the latter dictating the elementary behavior order for behavior reasoning, with a priori knowledge in system profile for normality detection. By integrating the activities, situation context, and profile knowledge we can have a better understanding of patients in a monitoring system. In activity recognition, a Negation-Selection mechanism is developed. which employs a divide-and-conquer concept with the Negation using posture transition to preclude the negative set from the activities. The Selection that follows the Negation uses a moving history trace for activity recognition. Such a history trace composes not only the pose from single frame, but also history trajectory information. As a result, the activity can be more accurately identified. The developed approach has been established into a nursing care monitoring system for elder's daily life behaviors. Results have shown the promise of the approach which can accurately interpret 85% of the regular daily behavior. In addition, the approach is also applied to accident detection which was found to have 90% accuracy with 0% false alarm.

[1]  Solomon Kullback,et al.  Information Theory and Statistics , 1970, The Mathematical Gazette.

[2]  Yap-Peng Tan,et al.  A vision-based approach to early detection of drowning incidents in swimming pools , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  James W. Davis,et al.  An appearance-based representation of action , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[4]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[5]  Takashi Omori,et al.  Detection of unusual human behavior in intelligent house , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[6]  R. Nelson,et al.  Low level recognition of human motion (or how to get your man without finding his body parts) , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[7]  Yunghsiang Sam Han,et al.  A practice of a collaborative multipoint medical teleconsultation system on broadband network , 2004, J. High Speed Networks.

[8]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[9]  Shyamsundar Rajaram,et al.  Human Activity Recognition Using Multidimensional Indexing , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Mohammed Yeasin,et al.  Towards a unified framework for tracking and analysis of human motion , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[11]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Seiji Ishikawa,et al.  Recognizing human behavior using universal eigenspace , 2002, Object recognition supported by user interaction for service robots.

[13]  James W. Davis Hierarchical motion history images for recognizing human motion , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[14]  Randal C. Nelson,et al.  Recognizing activities , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[15]  Chien-Shun Lo,et al.  A mammography tele-consultation pilot system in Taiwan , 2000, J. High Speed Networks.

[16]  MARION E. KALKMAN,et al.  Recognizing , 1968 .

[17]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[18]  Osama Masoud,et al.  Recognizing human activities , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[19]  Anil K. Jain,et al.  Automatic classification of tennis video for high-level content-based retrieval , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[20]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  A F Bobick,et al.  Movement, activity and action: the role of knowledge in the perception of motion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  Hisashi Miyamori,et al.  Video annotation for content-based retrieval using human behavior analysis and domain knowledge , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).