Semi-automated system for predicting calories in photographs of meals

Obesity is increasing globally. Obesity brings with it many chronic conditions. There has been increasing research in the use of ICT interventions to combat obesity using food logging and image calorie analysis. These interventions allow users to document their calorie intake to help promote healthy living. However using food logs may lead to inaccurate readings as the user may incorrectly calculate portion size when recording nutritional information. This paper discusses the use of image nutritional analysis techniques to ascertain a more accurate calorie reading from photographs of food items. The methods employed involve determining a ground truth data set by correlating weight of a food item with its area in cm2. This dataset could then be plotted on a regression model and used to determine calorie content of future portions. The proposed system uses a semi-automated approach to allow users to manually draw around the food portion using a polygonal tool. Results show that the application achieved a reasonable accuracy in predicting the calorie content of food item portions with a 11.82% percentage error.

[1]  Daniel P. Siewiorek,et al.  Wearable context-aware food recognition for calorie monitoring , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[2]  A. Must,et al.  Risks and consequences of childhood and adolescent obesity , 1999, International Journal of Obesity.

[3]  A McGaffey,et al.  Can Elvis Pretzley and the Fitwits improve knowledge of obesity, nutrition, exercise, and portions in fifth graders? , 2010, International Journal of Obesity.

[4]  Ilkka Korhonen,et al.  Use of a mobile phone diary for observing weight management and related behaviours , 2010, Journal of telemedicine and telecare.

[5]  M. Butryn,et al.  Behavioral approaches to the treatment of obesity. , 2012 .

[6]  Kimberly A. Patton Teens and Technology , 2011 .

[7]  S. Caprio,et al.  Type 2 Diabetes in Youth: Epidemiology and Pathophysiology , 2011, Diabetes Care.

[8]  Corby K. Martin,et al.  A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography method. , 2008, The British journal of nutrition.

[9]  Alison Avenell,et al.  Behavioural Interventions for Obese Adults with Additional Risk Factors for Morbidity: Systematic Review of Effects on Behaviour, Weight and Disease Risk Factors , 2010, Obesity Facts.

[10]  C. Ebbeling,et al.  Childhood obesity: public-health crisis, common sense cure , 2002, The Lancet.

[11]  R. N. Shebiah,et al.  Fruit Recognition using Color and Texture Features , 2010 .

[12]  T. Byers,et al.  Do obese children become obese adults? A review of the literature. , 1993, Preventive medicine.

[13]  Philip Zeitler,et al.  Acute and chronic complications of type 2 diabetes mellitus in children and adolescents , 2007, The Lancet.

[14]  Shervin Shirmohammadi,et al.  An image procesing approach for calorie intake measurement , 2012, 2012 IEEE International Symposium on Medical Measurements and Applications Proceedings.

[15]  Ilkka Korhonen,et al.  Mobile Diary for Wellness Management—Results on Usage and Usability in Two User Studies , 2008, IEEE Transactions on Information Technology in Biomedicine.

[16]  Victoria J. Burley,et al.  Development of ‘My Meal Mate’ – A smartphone intervention for weight loss , 2013 .

[17]  Keiji Yanai,et al.  Real-Time Mobile Food Recognition System , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[18]  W. Dietz,et al.  Guidelines for overweight in adolescent preventive services: recommendations from an expert committee. The Expert Committee on Clinical Guidelines for Overweight in Adolescent Preventive Services. , 1994, The American journal of clinical nutrition.

[19]  Shervin Shirmohammadi,et al.  Intelligent SVM based food intake measurement system , 2013, 2013 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[20]  Gaetano Borriello,et al.  2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops Design and Evaluation of a Food Index-based Nutrition Diary , 2022 .

[21]  Juan I. Nieto-Hipólito,et al.  A proposal for using the internet of things concept to increase children's health awareness , 2012, CONIELECOMP 2012, 22nd International Conference on Electrical Communications and Computers.

[22]  S. Jebb,et al.  Foresight. Tackling obesities: future choices. Project report. , 2007 .

[23]  Krzysztof Z. Gajos,et al.  Platemate: crowdsourcing nutritional analysis from food photographs , 2011, UIST.