Activity recognition using a panoramic camera for homecare

On the aged society coming soon, many studies have explored homecare technologies. In this work, the activities at home are captured by a panoramic camera located at the center of a living room, and then analyzed and classified into standing, walking, sitting, falling, and watching television. First, the background subtraction scheme accompanied with shadow removal, and morphological operators of erosion and dilation is used to find out moving subjects, and TV on/off switching. Second, the parameters associated with the subject height, the distance between the camera and subject, and the distance map between subject contour points and centroid are computed to derive features for recognizing activities of standing, walking, sitting, and falling where the Support Vector Machine (SVM) classifier is employed. Additionally, the moving object similar to a parallelogram shape is identified as a TV set. Third, the majority voting in a picture segment of 10 pictures is adopted to determine the final recognition result. When subject sitting and TV on occur simultaneously, this situation is treated as an activity of watching TV. The experimental results reveal that our activity recognition system can achieve the accuracy rate up to 91.1%. The error rates associated with subject height and distance estimations are around 5.5% and 8.2%, respectively. The accuracies of TV on and off detection are close to 95.9% and 100.0%, respectively. Therefore, the proposed activity recognition system exhibits a superior performance for homecare applications.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  Hsi-Pin Ma,et al.  A fall detection system based on infrared array sensors with tracking capability for the elderly at home , 2015, 2015 17th International Conference on E-health Networking, Application & Services (HealthCom).

[3]  Daijin Kim,et al.  Ridge body parts features for human pose estimation and recognition from RGB-D video data , 2014, Fifth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[4]  Megha D. Bengalur Human activity recognition using body pose features and support vector machine , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[5]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[6]  Fillia Makedon,et al.  Short-Term Recognition of Human Activities Using Convolutional Neural Networks , 2016, 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[7]  Calvin R. Maurer,et al.  A Linear Time Algorithm for Computing Exact Euclidean Distance Transforms of Binary Images in Arbitrary Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Xinghao Jiang,et al.  Human activity recognition based on pose points selection , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[9]  Daijin Kim,et al.  A spatiotemporal motion variation features extraction approach for human tracking and pose-based action recognition , 2015, 2015 International Conference on Informatics, Electronics & Vision (ICIEV).

[10]  C. H. Tsai,et al.  Home activity log and life care using panoramic videos , 2016 .

[11]  Yuncai Liu,et al.  A Rectangle Detection Method for Real-Time Extraction of Large Panel Edge , 2011, 2011 Sixth International Conference on Image and Graphics.