Imaged based estimation of food volume using circular referents in dietary assessment.

Measuring food volume (portion size) is a critical component in both clinical and research dietary studies. With the wide availability of cell phones and other camera-ready mobile devices, food pictures can be taken, stored or transmitted easily to form an image based dietary record. Although this record enables a more accurate dietary recall, a digital image of food usually cannot be used to estimate portion size directly due to the lack of information about the scale and orientation of the food within the image. The objective of this study is to investigate two novel approaches to provide the missing information, enabling food volume estimation from a single image. Both approaches are based on an elliptical reference pattern, such as the image of a circular pattern (e.g., circular plate) or a projected elliptical spotlight. Using this reference pattern and image processing techniques, the location and orientation of food objects and their volumes are calculated. Experiments were performed to validate our methods using a variety of objects, including regularly shaped objects and food samples.

[1]  José Mario Martínez,et al.  Quasi-Newton methods for solving underdetermined nonlinear simultaneous equations , 1991 .

[2]  M Vahter,et al.  Validation with biological markers for food intake of a dietary assessment method used by Swedish women with three different dietary preferences. , 1998, Public health nutrition.

[3]  Cheng-Jin Du,et al.  Estimating the surface area and volume of ellipsoidal ham using computer vision , 2006 .

[4]  Arshag D Mooradian,et al.  Evidence-based nutrition principles and recommendations for the treatment and prevention of diabetes and related complications. , 2002, Diabetes care.

[5]  Beno Benhabib,et al.  Three-dimensional location estimation of circular features for machine vision , 1992, IEEE Trans. Robotics Autom..

[6]  Donald A Williamson,et al.  Comparison of digital photography to weighed and visual estimation of portion sizes. , 2003, Journal of the American Dietetic Association.

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  Sandria Godwin,et al.  A new portion size estimation aid for wedge-shaped foods. , 2006, Journal of the American Dietetic Association.

[9]  J. Palmgren,et al.  Reproducibility and validity of dietary assessment instruments. II. A qualitative food frequency questionnaire. , 1988, American journal of epidemiology.

[10]  J. Montville,et al.  USDA Food and Nutrient Database for Dietary Studies (FNDDS), 5.0☆ , 2013 .

[11]  Mingui Sun,et al.  A food portion size measurement system for image-based dietary assessment , 2009, 2009 IEEE 35th Annual Northeast Bioengineering Conference.

[12]  S Wacholder,et al.  When Measurement Errors Correlate with Truth: Surprising Effects of Nondifferential Misclassification , 1995, Epidemiology.

[13]  D. Schoeller,et al.  Evaluation of dietary assessment instruments against doubly labeled water, a biomarker of habitual energy intake. , 2001, American journal of physiology. Endocrinology and metabolism.

[14]  Jennifer L. Crafts,et al.  Assessment of the accuracy of portion size reports using computer-based food photographs aids in the development of an automated self-administered 24-hour recall. , 2010, Journal of the American Dietetic Association.

[15]  L. Cupples,et al.  Validation of two-dimensional models for estimation of portion size in nutrition research. , 1992, Journal of the American Dietetic Association.

[16]  David S. Ebert,et al.  The Use of Mobile Devices in Aiding Dietary Assessment and Evaluation , 2010, IEEE Journal of Selected Topics in Signal Processing.

[17]  K Eskridge,et al.  Comparability of four methods for estimating portion sizes during a food frequency interview with caregivers of young children. , 1994, Journal of the American Dietetic Association.

[18]  Julie M. Harris,et al.  Accuracy of estimates of food portion size using food photographs – the importance of using age-appropriate tools , 2006, Public Health Nutrition.

[19]  Corby K. Martin,et al.  Empirical evaluation of the ability to learn a calorie counting system and estimate portion size and food intake , 2007, British Journal of Nutrition.

[20]  G J Petot,et al.  Validity of portion-size measurement aids: a review. , 1997, Journal of the American Dietetic Association.

[21]  Mingui Sun,et al.  Determination of food portion size by image processing , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  K R Westerterp,et al.  Underreporting of habitual food intake is explained by undereating in highly motivated lean women. , 1999, The Journal of nutrition.

[23]  Corby K. Martin,et al.  A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography method. , 2008, The British journal of nutrition.

[24]  David M Nathan,et al.  10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes Study. , 2009, Lancet.

[25]  E Riboli,et al.  Validation of a method for the estimation of food portion size. , 1992, Epidemiology.

[26]  Abby G Ershow,et al.  An overview of methodologies, proficiencies, and training resources for controlled feeding studies. , 2003, Journal of the American Dietetic Association.

[27]  F. Clavel-Chapelon,et al.  Estimation of food portion size using photographs: validity, strengths, weaknesses and recommendations , 1995 .

[28]  Yiu Cheung Shiu,et al.  3D location of circular and spherical features by monocular model-based vision , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[29]  Ajith Abraham,et al.  A New Approach for Solving Nonlinear Equations Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[30]  A. Goris,et al.  Undereating and underrecording of habitual food intake in obese men: selective underreporting of fat intake. , 2000, The American journal of clinical nutrition.

[31]  Sing Kiong Nguang,et al.  Low cost sensor for volume and surface area computation of axi-symmetric agricultural products , 2007 .

[32]  J. Palmgren,et al.  Reproducibility and validity of dietary assessment instruments. I. A self-administered food use questionnaire with a portion size picture booklet. , 1988, American journal of epidemiology.

[33]  Mingui Sun,et al.  Food volume estimation using a circular reference in image-based dietary studies , 2010, Proceedings of the 2010 IEEE 36th Annual Northeast Bioengineering Conference (NEBEC).

[34]  M. Nelson,et al.  Food Photography I: the perception of food portion size from photographs , 1994, British Journal of Nutrition.

[35]  J. Gerberding,et al.  Actual causes of death in the United States, 2000. , 2004, JAMA.

[36]  M. Nelson,et al.  Food photographs: practical guidelines II. Development and use of photographic atlases for assessing food portion size. , 1998, Public health nutrition.

[37]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[38]  E J Delp,et al.  Use of technology in children’s dietary assessment , 2009, European Journal of Clinical Nutrition.

[39]  Da‐hong Wang,et al.  The application of a handheld personal digital assistant with camera and mobile phone card (Wellnavi) to the general population in a dietary survey. , 2007, Journal of nutritional science and vitaminology.

[40]  Mingui Sun,et al.  A wearable electronic system for objective dietary assessment. , 2010, Journal of the American Dietetic Association.

[41]  L. Serra-Majem,et al.  A review of the use of information and communication technologies for dietary assessment , 2009, British Journal of Nutrition.

[42]  B E Ainsworth,et al.  Compendium of physical activities: an update of activity codes and MET intensities. , 2000, Medicine and science in sports and exercise.

[43]  Abby G. Ershow,et al.  Engineering Approaches to Energy Balance and Obesity: Opportunities for Novel Collaborations and Research , 2007, Journal of diabetes science and technology.

[44]  F. G. Berzolari,et al.  An evaluation of a colour food photography atlas as a tool for quantifying food portion size in epidemiological dietary surveys , 2005, European Journal of Clinical Nutrition.

[45]  Elaine R Monsen,et al.  Nutrition in the prevention and treatment of disease , 2013 .

[46]  J. Hankin,et al.  A comparison of frequency and quantitative dietary methods for epidemiologic studies of diet and disease. , 1984, American journal of epidemiology.

[47]  C. Frobisher,et al.  The estimation of food portion sizes: a comparison between using descriptions of portion sizes and a photographic food atlas by children and adults. , 2003, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[48]  Mingui Sun,et al.  ASSESSMENT OF FOOD INTAKE AND PHYSICAL ACTIVITY: A COMPUTATIONAL APPROACH , 2009 .