Anthropometry and soft biometrics for smart monitoring

The increasingly rapid convergence between machine and human languages has created a growing interest In the semintic analysis ofmultimedia contents. Despite the recent technological progresses, much remains to study in order to fill the semantic gap, the lack ofcoincidence between the information the machine extracts from raw data and the way humans interpret that content. Soft Biometrics (SB)represent the recent advances that Biometric research performed in these regards.Those traits have attracted the attention of theresearch community in that they have some characteristics peculiar to Hard Biometrics while they improve the semantic content theycarry. In this dissertation we explore the Body SB concept both from a theoretical and a practical point of view. Taking advantage ofdataset used for medicals and demographics studies, we analyze the relation between body parts and personal traits like anthropometricmeasures, weight, and gender. The ability to extract this information is tested by using both the 2D image analysis and by processing 3D video streams. We use SB for pruning a biometric database, enabling faster and more accurate response of a face recognition system.Moreover, we build an application that demonstrates the feasibility of people re-identification for limited groups of users. Furthermore, we present two medical applications for health conditions tracking. The former enables the interaction between the user and an automaticsystem that performs a medical check up of user’s body, providing hints and lifestyle suggestions. The latter Is intended to support themonitoring of cosmonauts’ weight losses due to the lack of gravity in outer space.

[1]  Koichi Maru,et al.  Instrument for Measuring the Body Mass of Astronauts Under Microgravity Conditions , 2010 .

[2]  Jean-Luc Dugelay,et al.  Building the space scale or how to weigh a person with no gravity , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[3]  Charlene Compher,et al.  Comparison of predictive equations for resting metabolic rate in healthy nonobese and obese adults: a systematic review. , 2005, Journal of the American Dietetic Association.

[4]  Guodong Guo,et al.  Gender from Body: A Biologically-Inspired Approach with Manifold Learning , 2009, ACCV.

[5]  Michael J. Black,et al.  Combined discriminative and generative articulated pose and non-rigid shape estimation , 2007, NIPS.

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[8]  Remo Sala,et al.  New method for height estimation of subjects represented in photograms taken from video surveillance systems , 2007, International Journal of Legal Medicine.

[9]  Jun-Ming Lu,et al.  Automated anthropometric data collection using 3D whole body scanners , 2008, Expert Syst. Appl..

[10]  David A. Winter,et al.  Human balance and posture control during standing and walking , 1995 .

[11]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  N. Kaushik,et al.  A Novel Beard Removal Method based on Structural Similarity and Co-ordinate Transformations , 2006, 2006 Annual IEEE India Conference.

[13]  Katrin Pirker Human Body Volume Estimation in a Clinical Environment , 2009 .

[14]  Ivo Alberink,et al.  Comparison of the Performance of Two Methods for Height Estimation , 2010, Journal of forensic sciences.

[15]  J. Shepherd,et al.  Adult Eyewitness Testimony: Whole body information: Its relevance to eyewitnesses , 1994 .

[16]  K. Srinathan,et al.  Efficient privacy preserving video surveillance , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Jean-Luc Dugelay,et al.  People re-identification in camera networks based on probabilistic color histograms , 2011, Electronic Imaging.

[18]  Jong-Soo Choi,et al.  A single-view based framework for robust estimation of heights and positions of moving people , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[19]  Johannes Peltola,et al.  Soft biometrics - combining body weight and fat measurements with fingerprint biometrics , 2006, Pattern Recognit. Lett..

[20]  Ioannis A. Kakadiaris,et al.  Estimating anthropometry and pose from a single image , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): a open and extensible framework for event based surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[22]  Ramin Zabih,et al.  Counting people from multiple cameras , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[23]  George Pavlich,et al.  The subjects of criminal identification , 2009 .

[24]  Mislav Grgic,et al.  Independent comparative study of PCA, ICA, and LDA on the FERET data set , 2005, Int. J. Imaging Syst. Technol..

[25]  Xuelong Li,et al.  Gait Components and Their Application to Gender Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  Michael J. Black,et al.  Estimating human shape and pose from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[27]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[28]  Tarak Gandhi,et al.  Distributed interactive video arrays for event capture and enhanced situational awareness , 2005, IEEE Intelligent Systems.

[29]  Harry Wechsler,et al.  Mixture of experts for classification of gender, ethnic origin, and pose of human faces , 2000, IEEE Trans. Neural Networks Learn. Syst..

[30]  Peter J. van Koppen,et al.  Portraying Perpetrators; The Validity of Offender Descriptions by Witnesses , 1997 .

[31]  Touradj Ebrahimi,et al.  Scrambling for Video Surveillance with Privacy , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[32]  Cordelia Schmid,et al.  Human Detection Based on a Probabilistic Assembly of Robust Part Detectors , 2004, ECCV.

[33]  Venu Govindaraju,et al.  Efficient search and retrieval in biometric databases , 2005, SPIE Defense + Commercial Sensing.

[34]  Mark S. Nixon,et al.  Eye Spacing Measurement for Facial Recognition , 1985, Optics & Photonics.

[35]  Sushil J. Louis,et al.  Genetic feature subset selection for gender classification: a comparison study , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[36]  Sina Samangooei Semantic biometrics , 2010 .

[37]  Kazuhito Shimada,et al.  Issues with Body Mass Measurement on the International Space Station (ISS) , 2010 .

[38]  Anil K. Jain,et al.  Can soft biometric traits assist user recognition? , 2004, SPIE Defense + Commercial Sensing.

[39]  Yunus Saatci,et al.  Cascaded classification of gender and facial expression using active appearance models , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[40]  Rama Chellappa,et al.  Recent advances in age and height estimation from still images and video , 2011, Face and Gesture 2011.

[41]  Michael J. Black,et al.  Home 3D body scans from noisy image and range data , 2011, 2011 International Conference on Computer Vision.

[42]  Matti Pietikäinen,et al.  Color-based face detection using skin locus model and hierarchical filtering , 2002, Object recognition supported by user interaction for service robots.

[43]  William L Hall,et al.  Errors in weight estimation in the emergency department: comparing performance by providers and patients. , 2004, The Journal of emergency medicine.

[44]  Ilkka Korhonen,et al.  Health monitoring in the home of the future. , 2003, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[45]  Harry Wechsler,et al.  Gender and ethnic classification of human faces using hybrid classifiers , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[46]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[47]  Jean-Luc Dugelay,et al.  Bag of soft biometrics for person identification , 2010, Multimedia Tools and Applications.

[48]  J. Dugelay,et al.  Demographic classification: Do gender and ethnicity affect each other? , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[49]  Seong G. Kong,et al.  Fusion of Visual and Thermal Signatures with Eyeglass Removal for Robust Face Recognition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[50]  Anne-Maree Kelly,et al.  How accurate is weight estimation in the emergency department? , 2005, Emergency medicine Australasia : EMA.

[51]  Izzet Duyar,et al.  Body height estimation based on tibia length in different stature groups. , 2003, American journal of physical anthropology.

[52]  Bir Bhanu,et al.  Statistical feature fusion for gait-based human recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[53]  T. R. Coe,et al.  The accuracy of visual estimation of weight and height in pre‐operative supine patients , 1999, Anaesthesia.

[54]  John N. Avaritsiotis,et al.  Gait analysis and automatic gait event identification using accelerometers , 2008, 2008 8th IEEE International Conference on BioInformatics and BioEngineering.

[55]  V. Tillmann,et al.  Diurnal variation in height and the reliability of height measurements using stretched and unstretched techniques in the evaluation of short-term growth. , 2001, Annals of human biology.

[56]  Mohamed Chetouani,et al.  Automatic gait characterization for a mobility assistance system , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[57]  Jean-Luc Dugelay,et al.  Person recognition using a bag of facial soft biometrics (BoFSB) , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[58]  N.B. Puhan,et al.  A novel iris database indexing method using the iris color , 2008, 2008 3rd IEEE Conference on Industrial Electronics and Applications.

[59]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[60]  Anil K. Jain,et al.  Soft Biometric Traits for Continuous User Authentication , 2010, IEEE Transactions on Information Forensics and Security.

[61]  A.K. Jain,et al.  Scars, marks and tattoos (SMT): Soft biometric for suspect and victim identification , 2008, 2008 Biometrics Symposium.

[62]  Wolfgang Straßer,et al.  3D Surveillance A Distributed Network of Smart Cameras for Real-Time Tracking and its Visualization in 3D , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[63]  A. Dantcheva,et al.  Bag of Soft Biometrics for Person Identification New trends and challenges , 2011 .

[64]  Xiaoyi Jiang,et al.  Towards Detection of Glasses in Facial Images , 2000, Pattern Analysis & Applications.

[65]  Jean-Luc Dugelay,et al.  Facial gender recognition using multiple sources of visual information , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[66]  Arun Ross,et al.  Predictability and correlation in human metrology , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[67]  Kewal Krishan,et al.  Establishing correlation of footprints with body weight--forensic aspects. , 2008, Forensic science international.

[68]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[69]  D Crawford,et al.  Lay definitions of ideal weight and overweight , 1999, International Journal of Obesity.

[70]  Massimo Piccardi,et al.  Height measurement as a session-based biometric for people matching across disjoint camera views , 2005 .

[71]  C. Nelson The Development and Neural Bases of Face Recognition , 2001 .

[72]  Arun Ross,et al.  Handbook of Multibiometrics , 2006, The Kluwer international series on biometrics.

[73]  C. L. Kien,et al.  Prediction of daily energy expenditure during a feeding trial using measurements of resting energy expenditure, fat-free mass, or Harris-Benedict equations. , 2004, The American journal of clinical nutrition.

[74]  N. Hamdy,et al.  Soft and hard biometrics fusion for improved identity verification , 2004, The 2004 47th Midwest Symposium on Circuits and Systems, 2004. MWSCAS '04..

[75]  J. Read,et al.  Adult Eyewitness Testimony: Current Trends and Developments , 2007 .

[76]  Mark S. Nixon,et al.  Performing content-based retrieval of humans using gait biometrics , 2008, Multimedia Tools and Applications.

[77]  Jean-Luc Dugelay,et al.  Real time extraction of body soft biometric from 3D videos , 2011, MM '11.

[78]  Shumeet Baluja,et al.  Boosting Sex Identification Performance , 2005, International Journal of Computer Vision.

[79]  A. Giron,et al.  Influence of facial skin attributes on the perceived age of Caucasian women , 2008, Journal of the European Academy of Dermatology and Venereology : JEADV.

[80]  Phil Sallee,et al.  Training and feature-reduction techniques for human identification using anthropometry , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[81]  Roger W. Johnson,et al.  Exploring Relationships in Body Dimensions , 2003 .

[82]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[83]  Rajanish Dass,et al.  Challenges of Identity Management - A Context in Rural India , 2009, ISDF.

[84]  Hans Weda,et al.  Automatic Children Detection in Digital Images , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[85]  Anil K. Jain,et al.  Ethnicity identification from face images , 2004, SPIE Defense + Commercial Sensing.

[86]  Hong Yan,et al.  Extraction of Glasses in Human Face Images , 2004, ICBA.

[87]  Kazuhito Shimada,et al.  Reconsideration of Body Mass Measurement on the International Space Station and Beyond , 2008 .

[88]  Bao-Liang Lu,et al.  Multi-view Gender Classification Using Local Binary Patterns and Support Vector Machines , 2006, ISNN.

[89]  Samy Bengio,et al.  Can Chimeric Persons Be Used in Multimodal Biometric Authentication Experiments? , 2005, MLMI.

[90]  Larry S. Davis,et al.  View-invariant Estimation of Height and Stride for Gait Recognition , 2002, Biometric Authentication.

[91]  P Meunier,et al.  Performance of a 2D image-based anthropometric measurement and clothing sizing system. , 2000, Applied ergonomics.

[92]  Ling Guan,et al.  Quantifying and recognizing human movement patterns from monocular video images-part II: applications to biometrics , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[93]  M C De Mendonça,et al.  Estimation of height from the length of long bones in a Portuguese adult population. , 2000, American journal of physical anthropology.

[94]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[95]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[96]  Kathleen M. Robinette,et al.  The CAESAR project: a 3-D surface anthropometry survey , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[97]  M. Pai,et al.  The Origin of the “Ideal” Body Weight Equations , 2000, The Annals of pharmacotherapy.

[98]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[99]  A. Matthews,et al.  'Children and obesity: a pan-European project examining the role of food marketing'. , 2008, European journal of public health.

[100]  A. Dantcheva Female facial aesthetics based on soft biometrics and photo-quality , 2011 .

[101]  Michael J. Black,et al.  A 2D Human Body Model Dressed in Eigen Clothing , 2010, ECCV.

[102]  Jean-Luc Dugelay,et al.  Weight estimation from visual body appearance , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[103]  M.S. Nixon,et al.  The Use of Semantic Human Description as a Soft Biometric , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[104]  Larry S. Davis,et al.  Estimation of Anthropomeasures from a Single Calibrated Camera , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[105]  A. O'Toole,et al.  Recognizing moving faces: a psychological and neural synthesis , 2002, Trends in Cognitive Sciences.

[106]  Shaogang Gong,et al.  Learning gender from human gaits and faces , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[107]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[108]  K. Ricanek,et al.  Aspects of Age Variation in Facial Morphology Affecting Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[109]  Matti Pietikäinen,et al.  Combining Contrast Information and Local Binary Patterns for Gender Classification , 2011, SCIA.

[110]  C. Hollenbeck,et al.  Comparison of ideal body weight equations and published height-weight tables with body mass index tables for healthy adults in the United States. , 2006, Nutrition in clinical practice : official publication of the American Society for Parenteral and Enteral Nutrition.

[111]  Gian Luca Marcialis,et al.  Group-specific face verification using soft biometrics , 2009, J. Vis. Lang. Comput..

[112]  D. Chorvat Three-dimensional measurement of human face with structured-light illumination , 2006 .

[113]  Afzal Godil,et al.  Human identification from body shape , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[114]  Malek Baklouti,et al.  Virtu4D : A dynamic audio-video virtual representation for surveillance systems , 2009, 2009 3rd International Conference on Signals, Circuits and Systems (SCS).

[115]  G. S. Daniels THE "AVERAGE MAN" ? , 1952 .

[116]  Slawomir Bak,et al.  Person Re-identification Using Spatial Covariance Regions of Human Body Parts , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[117]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[118]  Haiyuan Wu,et al.  Glasses frame detection with 3D Hough transform , 2002, Object recognition supported by user interaction for service robots.

[119]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.