Multi-part body segmentation based on depth maps for soft biometry analysis

A system for RGB-Depth human body segmentation and description is presented.Body clusters are automatically computed and a multi-class classifier is trained.3D alignment is performed within an iterative 3D shape context fitting approach.We show robust biometry measurements by applying orthogonal plates to body hull.Results on a novel data set improve segmentation accuracy in relation to RF. This paper presents a novel method extracting biometric measures using depth sensors. Given a multi-part labeled training data, a new subject is aligned to the best model of the dataset, and soft biometrics such as lengths or circumference sizes of limbs and body are computed. The process is performed by training relevant pose clusters, defining a representative model, and fitting a 3D shape context descriptor within an iterative matching procedure. We show robust measures by applying orthogonal plates to body hull. We test our approach in a novel full-body RGB-Depth data set, showing accurate estimation of soft biometrics and better segmentation accuracy in comparison with random forest approach without requiring large training data.

[1]  Jean-Luc Dugelay,et al.  Bag of soft biometrics for person identification , 2010, Multimedia Tools and Applications.

[2]  Kikuo Fujimura,et al.  A Bayesian Framework for Human Body Pose Tracking from Depth Image Sequences , 2010, Sensors.

[3]  Guodong Guo,et al.  Cross-Age Face Recognition on a Very Large Database: The Performance versus Age Intervals and Improvement Using Soft Biometric Traits , 2010, 2010 20th International Conference on Pattern Recognition.

[4]  Cristian Sminchisescu,et al.  Feature-Based Pose Estimation , 2011, Visual Analysis of Humans.

[5]  Trevor Darrell,et al.  Fast pose estimation with parameter-sensitive hashing , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Sridha Sridharan,et al.  Identifying Customer Behaviour and Dwell Time Using Soft Biometrics , 2012, Video Analytics for Business Intelligence.

[7]  Qinfen Zheng,et al.  Computational approaches for real-time extraction of soft biometrics , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[9]  Venu Govindaraju,et al.  Efficient search and retrieval in biometric databases , 2005, SPIE Defense + Commercial Sensing.

[10]  Michael J. Black,et al.  Home 3D body scans from noisy image and range data , 2011, 2011 International Conference on Computer Vision.

[11]  Sergio Escalera,et al.  Tri-modal Person Re-identification with RGB, Depth and Thermal Features , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Deva Ramanan,et al.  Learning to parse images of articulated bodies , 2006, NIPS.

[13]  Ankur Agarwal,et al.  A Local Basis Representation for Estimating Human Pose from Cluttered Images , 2006, ACCV.

[14]  DugelayJean-Luc,et al.  Bag of soft biometrics for person identification , 2011 .

[15]  Yu Chen,et al.  A Practical System for Modelling Body Shapes from Single View Measurements , 2011, BMVC.

[16]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[17]  Sergio Escalera,et al.  Automatic digital biometry analysis based on depth maps , 2013, Comput. Ind..

[18]  Jianbo Shi,et al.  Tele-graffiti: a pen and paper-based remote sketching system , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  E. Jeges,et al.  Measuring human height using calibrated cameras , 2008, 2008 Conference on Human System Interactions.

[20]  Sergio Escalera,et al.  Human limb segmentation in depth maps based on spatio-temporal Graph-cuts optimization , 2012, J. Ambient Intell. Smart Environ..

[21]  Sadiye Guler,et al.  Automated person categorization for video surveillance using soft biometrics , 2010, Defense + Commercial Sensing.

[22]  A. Volgenant,et al.  A shortest augmenting path algorithm for dense and sparse linear assignment problems , 1987, Computing.

[23]  Andrew Zisserman,et al.  2D Human Pose Estimation in TV Shows , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.

[24]  Benjamin Laxton,et al.  Monocular Human Pose Estimation , 2007 .

[25]  Nassir Navab,et al.  Estimating human 3D pose from Time-of-Flight images based on geodesic distances and optical flow , 2011, Face and Gesture 2011.

[26]  Ronald Poppe,et al.  Evaluating Example-based Pose Estimation: Experiments on the HumanEva Sets , 2007 .

[27]  Younjeong Lee,et al.  The Estimating Optimal Number of Gaussian Mixtures Based on Incremental k-means for Speaker Identification , 2006 .

[28]  Arun Ross,et al.  Predictability and correlation in human metrology , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[29]  Cristian Sminchisescu,et al.  Twin Gaussian Processes for Structured Prediction , 2010, International Journal of Computer Vision.

[30]  Ruigang Yang,et al.  Accurate 3D pose estimation from a single depth image , 2011, 2011 International Conference on Computer Vision.

[31]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Min Sun,et al.  Conditional regression forests for human pose estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Hiroshi Mizoguchi,et al.  A body dimensions estimation method of subject from a few measurement items using KINECT , 2012, IEEE International Conference on Systems, Man and Cybernetics.

[34]  Marcel Körtgen,et al.  3D Shape Matching with 3D Shape Contexts , 2003 .

[35]  F. Bookstein.  Thin-plate splines and decomposition of deformation , 1989 .