Accuracy of food portion size estimation from digital pictures acquired by a chest-worn camera

OBJECTIVE Accurate estimation of food portion size is of paramount importance in dietary studies. We have developed a small, chest-worn electronic device called eButton which automatically takes pictures of consumed foods for objective dietary assessment. From the acquired pictures, the food portion size can be calculated semi-automatically with the help of computer software. The aim of the present study is to evaluate the accuracy of the calculated food portion size (volumes) from eButton pictures. DESIGN Participants wore an eButton during their lunch. The volume of food in each eButton picture was calculated using software. For comparison, three raters estimated the food volume by viewing the same picture. The actual volume was determined by physical measurement using seed displacement. SETTING Dining room and offices in a research laboratory. SUBJECTS Seven lab member volunteers. RESULTS Images of 100 food samples (fifty Western and fifty Asian foods) were collected and each food volume was estimated from these images using software. The mean relative error between the estimated volume and the actual volume over all the samples was -2·8 % (95 % CI -6·8 %, 1·2 %) with sd of 20·4 %. For eighty-five samples, the food volumes determined by computer differed by no more than 30 % from the results of actual physical measurements. When the volume estimates by the computer and raters were compared, the computer estimates showed much less bias and variability. CONCLUSIONS From the same eButton pictures, the computer-based method provides more objective and accurate estimates of food volume than the visual estimation method.

[1]  Mingui Sun,et al.  Model-based measurement of food portion size for image-based dietary assessment using 3D/2D registration , 2013, Measurement science & technology.

[2]  Mingui Sun,et al.  3D/2D model-to-image registration for quantitative dietary assessment , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[3]  Corby K. Martin,et al.  A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography method. , 2008, The British journal of nutrition.

[4]  J. A. Yuhas,et al.  The impact of training, food type, gender, and container size on the estimation of food portion sizes. , 1989, Journal of the American Dietetic Association.

[5]  S. Sahin,et al.  Physical properties of foods , 2006 .

[6]  Deborah A Kerr,et al.  Adolescents in the United States can identify familiar foods at the time of consumption and when prompted with an image 14 h postprandial, but poorly estimate portions , 2011, Public Health Nutrition.

[7]  G. Block,et al.  A review of validations of dietary assessment methods. , 1982, American journal of epidemiology.

[8]  Hafza Dadabhoy,et al.  Children’s accuracy of portion size estimation using digital food images: effects of interface design and size of image on computer screen , 2010, Public Health Nutrition.

[9]  Mingui Sun,et al.  Food volume estimation using a circular reference in image-based dietary studies , 2010, Proceedings of the 2010 IEEE 36th Annual Northeast Bioengineering Conference (NEBEC).

[10]  Corby K. Martin,et al.  Validity of the Remote Food Photography Method (RFPM) for Estimating Energy and Nutrient Intake in Near Real‐Time , 2012, Obesity.

[11]  Stanley P. Cauvain Technology of Breadmaking , 1998 .

[12]  G J Petot,et al.  Validity of portion-size measurement aids: a review. , 1997, Journal of the American Dietetic Association.

[13]  Elaine R Monsen,et al.  Nutrition in the prevention and treatment of disease , 2013 .

[14]  Mingui Sun,et al.  3D localization of circular feature in 2D image and application to food volume estimation , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Jennifer L. Crafts,et al.  Assessment of the accuracy of portion size reports using computer-based food photographs aids in the development of an automated self-administered 24-hour recall. , 2010, Journal of the American Dietetic Association.

[16]  Amy F. Subar,et al.  CHAPTER 1 – Dietary Assessment Methodology , 2001 .

[17]  Mingui Sun,et al.  A wearable electronic system for objective dietary assessment. , 2010, Journal of the American Dietetic Association.

[18]  Bolland Je,et al.  The impact of training, food type, gender, and container size on the estimation of food portion sizes. , 1989 .

[19]  N E Day,et al.  Comparison of dietary assessment methods in nutritional epidemiology: weighed records v. 24 h recalls, food-frequency questionnaires and estimated-diet records , 1994, British Journal of Nutrition.

[20]  T G Lohman,et al.  Multimethod training increases portion-size estimation accuracy. , 1997, Journal of the American Dietetic Association.

[21]  L H Eck,et al.  Intense practice enhances accuracy of portion size estimation of amorphous foods. , 1997, Journal of the American Dietetic Association.

[22]  Kala Mayer,et al.  Childhood Obesity Prevention: Focusing on the Community Food Environment , 2009, Family & community health.

[23]  J. Matthews,et al.  Children's estimates of food portion size: the effect of timing of dietary interview on the accuracy of children's portion size estimates , 2007, British Journal of Nutrition.

[24]  Alinda Friedman,et al.  Food portion estimation by children with obesity: the effects of estimation method and food type. , 2012, Journal of the Academy of Nutrition and Dietetics.

[25]  Brendan Borrell,et al.  Epidemiology: Every bite you take , 2011, Nature.

[26]  P. Lanerolle,et al.  Food models for portion size estimation of Asian foods. , 2013, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[27]  M. Arroyo,et al.  A short training program improves the accuracy of portion-size estimates in future dietitians. , 2007, Archivos latinoamericanos de nutricion.

[28]  Jaakko Nevalainen,et al.  Food photographs in portion size estimation among adolescent Mozambican girls , 2012, Public Health Nutrition.

[29]  E. Barrett-Connor,et al.  Nutrition epidemiology: how do we know what they ate? , 1991, The American journal of clinical nutrition.

[30]  J. Stevens,et al.  Portion-size estimation training in second- and third-grade American Indian children. , 1999, The American journal of clinical nutrition.

[31]  Ajay Divakaran,et al.  Automatic food documentation and volume computation using digital imaging and electronic transmission. , 2010, Journal of the American Dietetic Association.

[32]  W. Rumpler,et al.  Identifying sources of reporting error using measured food intake , 2008, European Journal of Clinical Nutrition.

[33]  Sandria Godwin,et al.  A new portion size estimation aid for wedge-shaped foods. , 2006, Journal of the American Dietetic Association.

[34]  Antonio H Lancha,et al.  Selective underreporting of energy intake in women: magnitude, determinants, and effect of training. , 2003, Journal of the American Dietetic Association.

[35]  G. O'loughlin,et al.  Using a wearable camera to increase the accuracy of dietary analysis. , 2013, American journal of preventive medicine.

[36]  S. Atukorala,et al.  Portion size estimation aids for Asian foods. , 2012, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[37]  E J Delp,et al.  Use of technology in children’s dietary assessment , 2009, European Journal of Clinical Nutrition.

[38]  J. Stockman,et al.  Family Meals and Disordered Eating in Adolescents: Longitudinal Findings From Project EAT , 2009 .

[39]  Mingui Sun,et al.  ASSESSMENT OF FOOD INTAKE AND PHYSICAL ACTIVITY: A COMPUTATIONAL APPROACH , 2009 .

[40]  D H Calloway,et al.  Food intake measurement: problems and approaches. , 1983, The American journal of clinical nutrition.

[41]  Mingui Sun,et al.  Measurement of food volume based on single 2-D image without conventional camera calibration , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Corby K. Martin,et al.  Quantification of food intake using food image analysis , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  Mingui Sun,et al.  Distortion correction in wide-angle images for picture-based food portion size estimation , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[44]  Chiemi Onishi,et al.  Effects of lifestyle habits and eating meals together with the family on the prevalence of obesity among school children in Tokushima, Japan: a cross-sectional questionnaire-based survey. , 2008, The journal of medical investigation : JMI.

[45]  E. Delp,et al.  Comparison of Known Food Weights with Image-Based Portion-Size Automated Estimation and Adolescents' Self-Reported Portion Size , 2012, Journal of diabetes science and technology.

[46]  Julie M. Harris,et al.  Accuracy of estimates of food portion size using food photographs – the importance of using age-appropriate tools , 2006, Public Health Nutrition.

[47]  C. Byrd-Bredbenner,et al.  The effect of practical portion size measurement aids on the accuracy of portion size estimates made by young adults. , 2004, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[48]  Mingui Sun,et al.  Food volume estimation from a single image using virtual reality technology , 2011, 2011 IEEE 37th Annual Northeast Bioengineering Conference (NEBEC).

[49]  Zhen Li,et al.  Blur detection in image sequences recorded by a wearable camera , 2011, 2011 IEEE 37th Annual Northeast Bioengineering Conference (NEBEC).

[50]  J. Montville,et al.  USDA Food and Nutrient Database for Dietary Studies (FNDDS), 5.0☆ , 2013 .

[51]  David S. Ebert,et al.  The Use of Mobile Devices in Aiding Dietary Assessment and Evaluation , 2010, IEEE Journal of Selected Topics in Signal Processing.

[52]  Jie Li,et al.  Designing a wearable computer for lifestyle evaluation , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[53]  Mingui Sun,et al.  Imaged based estimation of food volume using circular referents in dietary assessment. , 2012, Journal of food engineering.

[54]  Helen Smiciklas-Wright,et al.  Accuracy in estimating and recalling portion sizes of foods among elderly adults , 2001 .

[55]  A. Anderson,et al.  Estimation of portion size in children's dietary assessment: lessons learnt , 2009, European Journal of Clinical Nutrition.