Significant Body Point Labeling and Tracking

In this paper, a method is presented to label and track anatomical landmarks (e.g., head, hand/arm, feet), which are referred to as significant body points (SBPs), using implicit body models. By considering the human body as an inverted pendulum model, ellipse fitting and contour moments are applied to classify it as being in Stand, Sit, or Lie posture. A convex hull of the silhouette contour is used to determine the locations of SBPs. The particle filter or a motion flow-based method is used to predict SBPs in occlusion. Stick figures of various activities are generated by connecting the SBPs. The qualitative and quantitative evaluation show that the proposed method robustly labels and tracks SBPs in various activities of two different (low and high) resolution data sets.

[1]  Emile A. Hendriks,et al.  Markerless human motion capture and pose recognition , 2009, 2009 10th Workshop on Image Analysis for Multimedia Interactive Services.

[2]  Peter H. N. de With,et al.  Flexible Human Behavior Analysis Framework for Video Surveillance Applications , 2010, Int. J. Digit. Multim. Broadcast..

[3]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[4]  Taesoo Kwon,et al.  Control systems for human running using an inverted pendulum model and a reference motion capture sequence , 2010, SCA '10.

[5]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[6]  Y. Yacoob,et al.  Statistical Estimation of Human Anthropometry from a Single Uncalibrated Image , 2008 .

[7]  Joseph Hamill,et al.  Biomechanical Basis of Human Movement , 1995 .

[8]  BlakeAndrew,et al.  C ONDENSATION Conditional Density Propagation forVisual Tracking , 1998 .

[9]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Dana Kulic,et al.  Local Shape Context Based Real-time Endpoint Body Part Detection and Identification from Depth Images , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[11]  Chia-Feng Juang,et al.  Human Body Posture Classification by a Neural Fuzzy Network and Home Care System Application , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Hossein Ragheb,et al.  MuHAVi: A Multicamera Human Action Video Dataset for the Evaluation of Action Recognition Methods , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[13]  Homa Foroughi,et al.  Distinguishing Fall Activities using Human Shape Characteristics , 2008, EIAT/IETA.

[14]  Ioannis A. Kakadiaris,et al.  Estimating Anthropometry and Pose from a Single Uncalibrated Image , 2001, Comput. Vis. Image Underst..

[15]  Rita Cucchiara,et al.  A multi‐camera vision system for fall detection and alarm generation , 2007, Expert Syst. J. Knowl. Eng..

[16]  Silvia Conforto,et al.  Markerless Human Motion Analysis in Gauss–Laguerre Transform Domain: An Application to Sit-To-Stand in Young and Elderly People , 2009, IEEE Transactions on Information Technology in Biomedicine.

[17]  Kazuhiro Kosuge,et al.  Control of a Robot Dancer for Enhancing Haptic Human-Robot Interaction in Waltz , 2012, IEEE Transactions on Haptics.

[18]  B. Bogin,et al.  Leg Length, Body Proportion, and Health: A Review with a Note on Beauty , 2010, International journal of environmental research and public health.

[19]  Jing-Jing Fang,et al.  Automatic body feature extraction from a marker-less scanned human body , 2007, Comput. Aided Des..

[20]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Juliane Junker,et al.  Kinesiology Scientific Basis Of Human Motion , 2016 .

[22]  Yaser Sheikh,et al.  Matching Trajectories of Anatomical Landmarks Under Viewpoint, Anthropometric and Temporal Transforms , 2009, International Journal of Computer Vision.

[23]  Kazuhiko Takahashi,et al.  Remarks on Simple Motion Capture Using Heuristic Rules and Monte Carlo Filter , 2009, 2009 Fifth International Conference on Image and Graphics.

[24]  E Takenaka,et al.  An image processing method for feature extraction of space-occupying lesions. , 1985, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[25]  Jenq-Neng Hwang,et al.  Connectivity Based Human Body Modeling from Monocular Camera , 2010, J. Inf. Sci. Eng..

[26]  Luc Van Gool,et al.  Human Pose Estimation Using Body Parts Dependent Joint Regressors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Peter H. N. de With,et al.  Fast Detection and Modeling of Human-Body Parts from Monocular Video , 2008, AMDO.

[28]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[29]  Andrew Zisserman,et al.  Human Pose Estimation Using a Joint Pixel-wise and Part-wise Formulation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Daniel Vélez Día,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[31]  Chia-Feng Juang,et al.  Computer Vision-Based Human Body Segmentation and Posture Estimation , 2009, SMC 2009.

[32]  Ian David Loram,et al.  Human balancing of an inverted pendulum: is sway size controlled by ankle impedance? , 2001, The Journal of physiology.

[33]  Yee-Hong Yang,et al.  First Sight: A Human Body Outline Labeling System , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Mao-Jiun J. Wang,et al.  Automated body feature extraction from 2D images , 2011, Expert Syst. Appl..

[35]  Jenq-Neng Hwang,et al.  Automatic Human Body Tracking and Modeling from Monocular Video Sequences , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[36]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[37]  Hossein Azizpour,et al.  Multi-view Body Part Recognition with Random Forests , 2013, BMVC.

[38]  Sheng Tang,et al.  Robust human body segmentation based on part appearance and spatial constraint , 2013, Neurocomputing.

[39]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[40]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[41]  Harish Bhaskar,et al.  Articulated human body parts detection based on cluster background subtraction and foreground matching , 2013, Neurocomputing.

[42]  A. E. Chapman,et al.  Biomechanical Analysis of Fundamental Human Movements , 2008 .

[43]  Ioannis A. Kakadiaris,et al.  On the improvement of anthropometry and pose estimation from a single uncalibrated image , 2003, Machine Vision and Applications.

[44]  Alexandru Telea,et al.  An Augmented Fast Marching Method for Computing Skeletons and Centerlines , 2002, VisSym.

[45]  Karl H.E. Kroemer,et al.  Anthropometry and Biomechanics , 1982 .