Smartphone-Based Food Weight and Calorie Estimation Method for Effective Food Journaling

World health statistics about overweight and obesity show that overweight, obesity and diet-related diseases still remain major health risks. According to the World Health Organization, most of the world’s population live in countries where overweight and obesity kill more people than underweight. Recently, many studies have been driven by the motivation of elaborating the “ideal” solutions to prevent and/or monitor overweight, obesity and diet-related diseases, and to encourage healthy diet and lifestyle. In this work, we present our idea to automatically measure food weight and calories, from food photo using ordinary chopsticks as a measurement reference. The analysis of the obtained results show that the use of near-by eating utensils combined with computer vision techniques is a great and exploitable approach to ubiquitously help in diet assessment and obesity treatment.

[1]  Jindong Tan,et al.  DietCam: Automatic dietary assessment with mobile camera phones , 2012, Pervasive Mob. Comput..

[2]  Mei Chen,et al.  Food recognition using statistics of pairwise local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Makoto Ogawa,et al.  Food Detection and Recognition Using Convolutional Neural Network , 2014, ACM Multimedia.

[4]  Mingui Sun,et al.  3D/2D model-to-image registration for quantitative dietary assessment , 2012, 2012 38th Annual Northeast Bioengineering Conference (NEBEC).

[5]  Wen Wu,et al.  Fast food recognition from videos of eating for calorie estimation , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[6]  J Utter,et al.  Under-reporting remains a key limitation of self-reported dietary intake: an analysis of the 2008/09 New Zealand Adult Nutrition Survey , 2014, European Journal of Clinical Nutrition.

[7]  Edward J. Delp,et al.  Food image analysis: Segmentation, identification and weight estimation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Behnoosh Hariri,et al.  A personal assistive system for nutrient intake monitoring , 2011, Ubi-MUI '11.

[9]  Marios Anthimopoulos,et al.  Two-View 3D Reconstruction for Food Volume Estimation , 2017, IEEE Transactions on Multimedia.

[10]  Laurence S Freedman,et al.  Addressing Current Criticism Regarding the Value of Self-Report Dietary Data. , 2015, The Journal of nutrition.

[11]  Antonio H Lancha,et al.  Selective underreporting of energy intake in women: magnitude, determinants, and effect of training. , 2003, Journal of the American Dietetic Association.

[12]  A. Goris,et al.  Undereating and underrecording of habitual food intake in obese men: selective underreporting of fat intake. , 2000, The American journal of clinical nutrition.

[13]  Keiji Yanai,et al.  FoodCam: A real-time food recognition system on a smartphone , 2015, Multimedia Tools and Applications.

[14]  Kiyoharu Aizawa,et al.  Image-based Calorie Content Estimation for Dietary Assessment , 2011, 2011 IEEE International Symposium on Multimedia.

[15]  Yutaka Arakawa,et al.  Happyinu: exploring how to use games and extrinsic rewards for consistent food tracking behavior , 2016, 2016 Ninth International Conference on Mobile Computing and Ubiquitous Networking (ICMU).

[16]  David S. Ebert,et al.  Technology-assisted dietary assessment , 2008, Electronic Imaging.

[17]  Sergio Guadarrama,et al.  Im2Calories: Towards an Automated Mobile Vision Food Diary , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Edward J. Delp,et al.  Combining global and local features for food identification in dietary assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[19]  Edward J. Delp,et al.  Analysis of food images: Features and classification , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[20]  Kiyoharu Aizawa,et al.  Food Balance Estimation by Using Personal Dietary Tendencies in a Multimedia Food Log , 2013, IEEE Transactions on Multimedia.

[21]  Yutaka Arakawa,et al.  Food Weight Estimation using Smartphone and Cutlery , 2016, IoTofHealth@MobiSys.

[22]  Kiyoharu Aizawa,et al.  FoodLog: capture, analysis and retrieval of personal food images via web , 2009, CEA '09.

[23]  David S. Ebert,et al.  Volume estimation using food specific shape templates in mobile image-based dietary assessment , 2011, Electronic Imaging.

[24]  Shervin Shirmohammadi,et al.  Measuring Calorie and Nutrition From Food Image , 2014, IEEE Transactions on Instrumentation and Measurement.

[25]  David S. Ebert,et al.  Automatic portion estimation and visual refinement in mobile dietary assessment , 2010, Electronic Imaging.