Image-based food volume estimation

In this paper, we propose an extension to our previous work on food portion size estimation using a single image and a multi-view volume estimation method. The single-view technique estimates food volume by using prior information (segmentation and food labels) generated from food identification methods we described earlier. For multi-view volume estimation, we use ``Shape from Silhouettes'' to estimate the food portion size. The experimental results of our volume estimation methods demonstrate our results with respect to accuracy and reliability.

[1]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[2]  E. Delp,et al.  Multilevel segmentation for food classification in dietary assessment , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[3]  Francis S. Hill,et al.  Computer Graphics Using Opengl, 3Rd Edition , 2015 .

[4]  Edward J. Delp,et al.  Food image analysis: Segmentation, identification and weight estimation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[5]  E. Delp,et al.  Novel Technologies for Assessing Dietary Intake: Evaluating the Usability of a Mobile Telephone Food Record Among Adults and Adolescents , 2012, Journal of medical Internet research.

[6]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[7]  Mingui Sun,et al.  A wearable electronic system for objective dietary assessment. , 2010, Journal of the American Dietetic Association.

[8]  Xing Zhang,et al.  A mobile structured light system for food volume estimation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Edward J. Delp,et al.  Integrated database system for mobile dietary assessment and analysis , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[10]  Mingui Sun,et al.  3D/2D model-to-image registration for quantitative dietary assessment , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[11]  Edward J. Delp,et al.  Snakes assisted food image segmentation , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[12]  Edward J. Delp,et al.  Combining global and local features for food identification in dietary assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Deborah A Kerr,et al.  Adolescents in the United States can identify familiar foods at the time of consumption and when prompted with an image 14 h postprandial, but poorly estimate portions , 2011, Public Health Nutrition.

[14]  E J Delp,et al.  Use of technology in children’s dietary assessment , 2009, European Journal of Clinical Nutrition.

[15]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[16]  Bruno M. C. Silva,et al.  SapoFitness: A mobile health application for dietary evaluation , 2011, 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services.

[17]  Martin R. Okos,et al.  Developing novel 3D measurement techniques and prediction method for food density determination , 2011 .

[18]  David S. Ebert,et al.  Volume estimation using food specific shape templates in mobile image-based dietary assessment , 2011, Electronic Imaging.

[19]  David S. Ebert,et al.  The Use of Mobile Devices in Aiding Dietary Assessment and Evaluation , 2010, IEEE Journal of Selected Topics in Signal Processing.

[20]  Edward J. Delp,et al.  Image enhancement and quality measures for dietary assessment using mobile devices , 2012, Electronic Imaging.

[21]  Jindong Tan,et al.  DietCam: Automatic dietary assessment with mobile camera phones , 2012, Pervasive Mob. Comput..

[22]  E. Delp,et al.  Evidence-based development of a mobile telephone food record. , 2010, Journal of the American Dietetic Association.

[23]  Jindong Tan,et al.  DietCam: Regular Shape Food Recognition with a Camera Phone , 2011, 2011 International Conference on Body Sensor Networks.

[24]  Francis J. Hill.  Computer Graphics Using Open GL , 1990 .

[25]  David S. Ebert,et al.  Automatic portion estimation and visual refinement in mobile dietary assessment , 2010, Electronic Imaging.

[26]  Edward J. Delp,et al.  Model-based food volume estimation using 3D pose , 2013, 2013 IEEE International Conference on Image Processing.

[27]  E. Delp,et al.  Comparison of Known Food Weights with Image-Based Portion-Size Automated Estimation and Adolescents' Self-Reported Portion Size , 2012, Journal of diabetes science and technology.

[28]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[29]  Mingui Sun,et al.  3D localization of circular feature in 2D image and application to food volume estimation , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.