Recognizing physical activity from ego-motion of a camera

A new image based activity recognition method for a person wearing a video camera below the neck is presented in this paper. The wearable device is used to capture video data in front of the wearer. Although the wearer never appears in the video, his or her physical activity is analyzed and recognized using the recorded scene changes resulting from the motion of the wearer. Correspondence features are extracted from adjacent frames and inaccurate matches are removed based on a set of constraints imposed by the camera model. Motion histograms are defined and calculated within a frame and we define a new feature called accumulated motion distribution derived from motion statistics in each frame. A Support Vector Machine (SVM) classifier is trained with this feature and used to classify physical activities in different scenes. Our results show that different types of activities can be recognized in low resolution, field acquired real-world video.

[1]  Qiang Liu,et al.  A sparse representation of physical activity video in the study of obesity , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[2]  Kent Larson,et al.  Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[3]  Abby G. Ershow,et al.  Engineering Approaches to Energy Balance and Obesity: Opportunities for Novel Collaborations and Research , 2007, Journal of diabetes science and technology.

[4]  James M. Rehg,et al.  A Scalable Approach to Activity Recognition based on Object Use , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Liang-Tien Chia,et al.  A new motion histogram to index motion content in video segments , 2005, Pattern Recognit. Lett..

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Ling Bao,et al.  Physical activity recognition from acceleration data under semi-naturalistic conditions , 2003 .

[8]  Jintao Li,et al.  Hierarchical spatio-temporal context modeling for action recognition , 2009, CVPR.

[9]  James W. Davis,et al.  The representation and recognition of human movement using temporal templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[11]  Patrick Pérez,et al.  Cross-View Action Recognition from Temporal Self-similarities , 2008, ECCV.

[12]  Barbara Caputo,et al.  Local velocity-adapted motion events for spatio-temporal recognition , 2007, Comput. Vis. Image Underst..

[13]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.