Using Computer Vision to Study the Effects of BMI on Online Popularity and Weight-Based Homophily

Increasing prevalence of obesity has disconcerting implications for communities, for nations and, most importantly, for individuals in aspects ranging from quality of life, longevity and health, to social and financial prosperity. Therefore, researchers from a variety of backgrounds study obesity from all angles. In this paper, we use a state-of-the-art computer vision system to predict a person’s body-mass index (BMI) from their social media profile picture and demonstrate the type of analyses this approach enables using data from two culturally diverse settings – the US and Qatar. Using large amounts of Instagram profile pictures, we show that (i) thinner profile pictures have more followers, and that (ii) there is weight-based network homophily in that users with a similar BMI tend to cluster together. To conclude, we also discuss the challenges and limitations related to inferring various user attributes from photos.

[1]  Lei Huang,et al.  Social Media Profiler: Inferring Your Social Media Personality from Visual Attributes in Portrait , 2016, PCM.

[2]  Ralph B D'Agostino,et al.  Body mass index, metabolic syndrome, and risk of type 2 diabetes or cardiovascular disease. , 2006, The Journal of clinical endocrinology and metabolism.

[3]  Saeed Abdullah,et al.  Collective Smile: Measuring Societal Happiness from Geolocated Images , 2015, CSCW.

[4]  Chih-Hua Tai,et al.  A Framework for Healthcare Everywhere: BMI Prediction Using Kinect and Data Mining Techniques on Mobiles , 2015, 2015 16th IEEE International Conference on Mobile Data Management.

[5]  Jason M. Fletcher,et al.  Detecting implausible social network effects in acne, height, and headaches: longitudinal analysis , 2008, BMJ : British Medical Journal.

[6]  D. Perrett,et al.  Facial Adiposity: A Cue to Health? , 2009, Perception.

[7]  Jisun An,et al.  #greysanatomy vs. #yankees: Demographics and Hashtag Use on Twitter , 2016, ICWSM.

[8]  K. Brownell,et al.  Perceptions of weight discrimination: prevalence and comparison to race and gender discrimination in America , 2008, International Journal of Obesity.

[9]  Sarah Vieweg,et al.  Surveillance & Modesty on Social Media: How Qataris Navigate Modernity and Maintain Tradition , 2016, CSCW.

[10]  Jesse Hoey,et al.  First Impressions - Predicting User Personality from Twitter Profile Images , 2016, HBU.

[11]  A. Wutich,et al.  Body Norms and Fat Stigma in Global Perspective , 2011, Current Anthropology.

[12]  Hamed Haddadi,et al.  #FoodPorn: Obesity Patterns in Culinary Interactions , 2015, Digital Health.

[13]  Lyle H. Ungar,et al.  Analyzing Personality through Social Media Profile Picture Choice , 2016, ICWSM.

[14]  Ingmar Weber,et al.  Crowdsourcing Health Labels: Inferring Body Weight from Profile Pictures , 2016, Digital Health.

[15]  N. Christakis,et al.  The Spread of Obesity in a Large Social Network Over 32 Years , 2007, The New England journal of medicine.

[16]  S. Vieweg,et al.  Privacy and Social Media Use in the Arabian Gulf: Saudi Arabian & Qatari Traditional Values in the Digital World , 2017 .

[17]  Guodong Guo,et al.  A computational approach to body mass index prediction from face images , 2013, Image Vis. Comput..

[18]  S. Daniels,et al.  The Use of BMI in the Clinical Setting , 2009, Pediatrics.

[19]  Sofiane Abbar,et al.  You Tweet What You Eat: Studying Food Consumption Through Twitter , 2014, CHI.

[20]  David I. Perrett,et al.  Perception of health from facial cues , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[21]  A. Prentice,et al.  Beyond body mass index , 2001, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[22]  Ingmar Weber,et al.  Demographic research with non-representative internet data , 2015 .

[23]  Antonio Torralba,et al.  Face-to-BMI: Using Computer Vision to Infer Body Mass Index on Social Media , 2017, ICWSM.

[24]  C. Spearman The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[25]  M. Tovée,et al.  Female and male perceptions of female physical attractiveness in front-view and profile. , 2001, British journal of psychology.

[26]  Weisi Lin,et al.  Do Others Perceive You As You Want Them To?: Modeling Personality based on Selfies , 2015, ASM@ACM Multimedia.