Show me your face and I will tell you your height, weight and body mass index

Body height, weight, as well as the associated and composite body mass index (BMI) are human attributes of pertinence due to their use in a number of applications including surveillance, re-identification, image retrieval systems, as well as healthcare. Previous work on automated estimation of height, weight and BMI has predominantly focused on 2D and 3D full-body images and videos. Little attention has been given to the use of face for estimating such traits. Motivated by the above, we here explore the possibility of estimating height, weight and BMI from single-shot facial images by proposing a regression method based on the 50-layers ResNet-architecture. In addition, we present a novel dataset consisting of 1026 subjects and show results, which suggest that facial images contain discriminatory information pertaining to height, weight and BMI, comparable to that of body-images and videos. Finally, we perform a gender-based analysis of the prediction of height, weight and BMI.

[1]  S Gibson,et al.  The importance of metabolic rate and the folly of body surface area calculations , 2003, Anaesthesia.

[2]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[3]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[4]  D. Perrett,et al.  Deciphering Faces: Quantifiable Visual Cues to Weight , 2010, Perception.

[5]  John N. Lunn,et al.  The National Confidential Enquiry into Perioperative Deaths , 1994, Journal of Clinical Monitoring.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  M. H. Gault,et al.  Prediction of creatinine clearance from serum creatinine. , 1975, Nephron.

[8]  Alison K Macpherson,et al.  Secular Trends in the Diagnosis and Treatment of Obesity Among US Adults in the Primary Care Setting , 2012, Obesity.

[9]  Jun-Hyeong Do,et al.  Body Mass Index and Facial Cues in Sasang Typology for Young and Elderly Persons , 2011, Evidence-based complementary and alternative medicine : eCAM.

[10]  D. Carney,et al.  Current concepts in nutritional assessment. , 2002, Archives of surgery.

[11]  Jean-Luc Dugelay,et al.  Building the space scale or how to weigh a person with no gravity , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[12]  Graeme MacLennan,et al.  Accuracy of weight and height estimation in an intensive care unit: Implications for clinical practice and research* , 2006, Critical care medicine.

[13]  Anil K. Jain,et al.  A Case Study on Unconstrained Facial Recognition Using the Boston Marathon Bombings Suspects , 2013 .

[14]  Charles Natanson,et al.  Meta-analysis of acute lung injury and acute respiratory distress syndrome trials testing low tidal volumes. , 2002, American journal of respiratory and critical care medicine.

[15]  Arun Ross,et al.  What Else Does Your Biometric Data Reveal? A Survey on Soft Biometrics , 2016, IEEE Transactions on Information Forensics and Security.

[16]  José Miguel Buenaposada,et al.  Robust gender recognition by exploiting facial attributes dependencies , 2014, Pattern Recognit. Lett..

[17]  Antitza Dantcheva,et al.  Gender Estimation Based on Smile-Dynamics , 2017, IEEE Transactions on Information Forensics and Security.

[18]  Arun Ross,et al.  Can facial metrology predict gender? , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[19]  Yan Wang,et al.  Deep View-Sensitive Pedestrian Attribute Inference in an end-to-end Model , 2017, BMVC.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Anil K. Jain,et al.  Soft Biometric Traits for Personal Recognition Systems , 2004, ICBA.

[22]  V. Piuri,et al.  Weight estimation from frame sequences using computational intelligence techniques , 2012, 2012 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings.

[23]  Thomas B. Moeslund,et al.  On soft biometrics , 2015, Pattern Recognit. Lett..

[24]  Guodong Guo,et al.  A computational approach to body mass index prediction from face images , 2013, Image Vis. Comput..

[25]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Brian L. Erstad,et al.  Dosing of medications in morbidly obese patients in the intensive care unit setting , 2004, Intensive Care Medicine.

[27]  Jean-Luc Dugelay,et al.  Weight estimation from visual body appearance , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[28]  Arun Ross,et al.  Predictability and correlation in human metrology , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[29]  G. Biolo,et al.  Enteral nutrition in intensive care patients: a practical approach , 2009, Intensive Care Medicine.

[30]  T. R. Coe,et al.  The accuracy of visual estimation of weight and height in pre‐operative supine patients , 1999, Anaesthesia.

[31]  Jean-Luc Dugelay,et al.  Bag of soft biometrics for person identification , 2010, Multimedia Tools and Applications.

[32]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[33]  J. Vincent,et al.  The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure , 1996, Intensive Care Medicine.

[34]  Arun Ross,et al.  Impact of facial cosmetics on automatic gender and age estimation algorithms , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[35]  Fiona Simpson,et al.  Parenteral vs. enteral nutrition in the critically ill patient: a meta-analysis of trials using the intention to treat principle , 2004, Intensive Care Medicine.

[36]  Xiangyang Xue,et al.  A Jointly Learned Deep Architecture for Facial Attribute Analysis and Face Detection in the Wild , 2017, ArXiv.