Pose recognition in indoor environments using a fisheye camera and a parametric human model

In this paper we present a system that uses computer vision techniques and a deformable 3D human model, in order to recognize the posture of a monitored person, given the segmented human silhouette from the background. The video data are acquired indoors from a fixed fish-eye camera placed in the living environment. The implemented 3D human model collaborates with a fish-eye camera model, allowing the calculation of the real human position in the 3D-space and consequently recognizing the posture of the monitored person. The paper discusses the details of the human model and fish-eye camera model, as well as the posture recognition methodology. Initial results are also presented for a small number of video sequences, of walking or standing humans.

[1]  Camillo J. Taylor,et al.  Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image , 2000, Comput. Vis. Image Underst..

[2]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[3]  Bart Vanrumste,et al.  How to detect human fall in video? An overview , 2009 .

[4]  Anup Basu,et al.  Modeling fish-eye lenses , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Jitendra Malik,et al.  Twist Based Acquisition and Tracking of Animal and Human Kinematics , 2004, International Journal of Computer Vision.

[7]  Kostas Delibasis,et al.  Near real-time human silhouette and movement detection in indoor environments using fixed cameras , 2012, PETRA '12.

[8]  Tomás Pajdla,et al.  Structure from motion with wide circular field of view cameras , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Jake K. Aggarwal,et al.  Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation , 1996, Pattern Recognit..

[11]  Olivier D. Faugeras,et al.  3D Articulated Models and Multiview Tracking with Physical Forces , 2001, Comput. Vis. Image Underst..

[12]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Hongdong Li,et al.  Plane-Based Calibration and Auto-calibration of a Fish-Eye Camera , 2006, ACCV.

[14]  Luc Van Gool,et al.  Markerless tracking of complex human motions from multiple views , 2006, Comput. Vis. Image Underst..

[15]  Keiichi Kemmotsu,et al.  Recognizing human behaviors with vision sensors in a network robot system , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[17]  Xi Chen,et al.  Activity Analysis, Summarization, and Visualization for Indoor Human Activity Monitoring , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Vassilis P. Plagianakos,et al.  Fisheye camera modeling for human segmentation refinement in indoor videos , 2013, PETRA '13.

[19]  Stefan Carlsson,et al.  Uncalibrated Motion Capture Exploiting Articulated Structure Constraints , 2004, International Journal of Computer Vision.

[20]  Masafumi Hashimoto,et al.  Human detection from fish-eye image by Bayesian combination of probabilistic appearance models , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[21]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ioannis A. Kakadiaris,et al.  Estimating Anthropometry and Pose from a Single Uncalibrated Image , 2001, Comput. Vis. Image Underst..

[23]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.