An Overview of the State of the Art of Automated Capture of Dietary Intake Information

Significant benefits arise from being able to capture dietary or nutritional intake information automatically or semi-automatically. These include the ability for individuals to know and understand their nutritional intake and hence improve their diet and health. To date, only highly manual processes such as 24-hour recall, food diaries, and food journals have been utilized which have been overly cumbersome for widespread adoption. Emerging informatics, computer vision, mobile computing, and sensor-based approaches are likely to play a role in further automating the capture of dietary intake information and these are becoming increasingly utilizable through such advents as the rapid and ubiquitous uptake of smartphones with built-in digital cameras and other sensors. In this paper, we review the state of the art of technologies for automatic capture of dietary intake information and identify significant outstanding research problems and promising directions.

[1]  Kathryn Anne-Marie Donnelly,et al.  Food industry information exchange and the role of meta-data and data lists , 2011, Int. J. Metadata Semant. Ontologies.

[2]  David S. Ebert,et al.  Volume estimation using food specific shape templates in mobile image-based dietary assessment , 2011, Electronic Imaging.

[3]  Robert Steele,et al.  Personal health record architectures: Technology infrastructure implications and dependencies , 2012, J. Assoc. Inf. Sci. Technol..

[4]  D. Greenwood,et al.  Use of itemized Till receipts to adjust for correlated dietary measurement error. , 2006, American journal of epidemiology.

[5]  B. J. Fogg Healthy Living with Persuasive Technologies : Framework , Issues , and Challenges , 2009 .

[6]  Xiaofeng Meng,et al.  RecipeCrawler: Collecting Recipe Data from WWW Incrementally , 2006, WAIM.

[7]  Melanie Swan,et al.  Sensor Mania! The Internet of Things, Wearable Computing, Objective Metrics, and the Quantified Self 2.0 , 2012, J. Sens. Actuator Networks.

[8]  David S. Ebert,et al.  Technology-assisted dietary assessment , 2008, Electronic Imaging.

[9]  C. Hawkes Food policies for healthy populations and healthy economies , 2012, BMJ : British Medical Journal.

[10]  David S. Ebert,et al.  The Use of Mobile Devices in Aiding Dietary Assessment and Evaluation , 2010, IEEE Journal of Selected Topics in Signal Processing.

[11]  E. Feldman Modern Nutrition in Health and Disease , 1999 .

[12]  John F. Hurdle,et al.  Linking supermarket sales data to nutritional information: an informatics feasibility study. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[13]  Mohsen Mesgarani,et al.  Book Review: Diet, Nutrition and the Prevention of Chronic Diseases , 2003, World Health Organization technical report series.

[14]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[15]  Edward J. Delp,et al.  Combining global and local features for food identification in dietary assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[16]  Mingui Sun,et al.  A wearable electronic system for objective dietary assessment. , 2010, Journal of the American Dietetic Association.

[17]  Ankur Teredesai,et al.  A pervasive Dietary Data Recording System , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[18]  M. Nestle Health care reform in action--calorie labeling goes national. , 2010, The New England journal of medicine.

[19]  Rebecca Eynon,et al.  Networked Individuals and Institutions: A Cross-Sector Comparative Perspective on Patterns and Strategies in Government and Research , 2009, Inf. Soc..

[20]  James L. Weinstein,et al.  A universal product code scanner is a feasible method of measuring household food inventory and food use patterns in low-income families. , 2006, Journal of the American Dietetic Association.

[21]  June Stevens,et al.  Exhaustive measurement of food items in the home using a universal product code scanner , 2010, Public Health Nutrition.

[22]  Desney S. Tan,et al.  Automatic classification of daily fluid intake , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[23]  John S. Strauss,et al.  Health nutrition and economic development. , 1998 .

[24]  Corby K. Martin,et al.  A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography method. , 2008, The British journal of nutrition.

[25]  Azucena Gracia,et al.  Does nutrition information on food products lead to healthier food choices , 2010 .

[26]  Anu Lehtiö,et al.  Personal Chart: Health Data Logging Made Easy with a Mobile Device , 2011, INTERACT.

[27]  Pei-Yu Chi,et al.  Enabling Calorie-Aware Cooking in a Smart Kitchen , 2008, PERSUASIVE.

[28]  Bruno M. C. Silva,et al.  SapoFitness: A mobile health application for dietary evaluation , 2011, 2011 IEEE 13th International Conference on e-Health Networking, Applications and Services.

[29]  Wolf-Joachim Fischer,et al.  Acoustical method for objective food intake monitoring using a wearable sensor system , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[30]  Mingui Sun,et al.  Food volume estimation using a circular reference in image-based dietary studies , 2010, Proceedings of the 2010 IEEE 36th Annual Northeast Bioengineering Conference (NEBEC).

[31]  Krzysztof Z. Gajos,et al.  Platemate: crowdsourcing nutritional analysis from food photographs , 2011, UIST.

[32]  Corby K. Martin,et al.  Quantification of food intake using food image analysis , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  K. Volpp,et al.  Enhancing the effectiveness of food labeling in restaurants. , 2010, JAMA.

[34]  Kiyoharu Aizawa,et al.  Image processing based approach to food balance analysis for personal food logging , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[35]  Yoshihiro Saeki,et al.  Proposal of Food Intake Measuring System in Medical Use and Its Discussion of Practical Capability , 2005, KES.

[36]  Robert Steele,et al.  Elderly persons' perception and acceptance of using wireless sensor networks to assist healthcare , 2009, Int. J. Medical Informatics.

[37]  R. Sturm,et al.  The effects of obesity, smoking, and drinking on medical problems and costs. , 2002, Health affairs.

[38]  David W. McDonald,et al.  Using Mobile & Personal Sensing Technologies to Support Health Behavior Change in Everyday Life: Lessons Learned , 2009, AMIA.

[39]  Jane Yung-jen Hsu,et al.  The Diet-Aware Dining Table: Observing Dietary Behaviors over a Tabletop Surface , 2006, Pervasive.

[40]  Dustin Ormond,et al.  Exploratory Study on Users' Behavior: Smartphone Usage , 2011, AMCIS.

[41]  Gerhard Tröster,et al.  On-Body Sensing Solutions for Automatic Dietary Monitoring , 2009, IEEE Pervasive Computing.

[42]  R. Hanning,et al.  Dietary assessment and self-monitoring with nutrition applications for mobile devices. , 2012, Canadian journal of dietetic practice and research : a publication of Dietitians of Canada = Revue canadienne de la pratique et de la recherche en dietetique : une publication des Dietetistes du Canada.

[43]  T. Sbrocco,et al.  Adherence and weight loss outcomes associated with food-exercise diary preference in a military weight management program. , 2009, Eating behaviors.

[44]  Jindong Tan,et al.  DietCam: Automatic dietary assessment with mobile camera phones , 2012, Pervasive Mob. Comput..

[45]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[46]  J. Who,et al.  Diet, nutrition and the prevention of chronic diseases : report of a Joint WHO/FAO Expert Consultation , 2003 .

[47]  G. Gard,et al.  “Peers, parents and phones”—Swedish adolescents and health promotion , 2012, International journal of qualitative studies on health and well-being.

[48]  L. Serra-Majem,et al.  A review of the use of information and communication technologies for dietary assessment , 2009, British Journal of Nutrition.

[49]  R L Karvetti,et al.  Validity of the 24-hour dietary recall. , 1985, Journal of the American Dietetic Association.

[50]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[51]  I. Tetens,et al.  Evaluation of a digital method to assess evening meal intake in a free-living adult population , 2010, Food & nutrition research.

[52]  W. Evans,et al.  Text4Baby: using text messaging to improve maternal and newborn health. , 2011, Nursing for women's health.

[53]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[54]  E. Delp,et al.  Evidence-based development of a mobile telephone food record. , 2010, Journal of the American Dietetic Association.

[55]  Oleksandr Makeyev,et al.  Automatic identification of the number of food items in a meal using clustering techniques based on the monitoring of swallowing and chewing , 2012, Biomed. Signal Process. Control..

[56]  Gary Hsieh,et al.  Using Low-Cost Sensing to Support Nutritional Awareness , 2002, UbiComp.

[57]  C. Finch The Biology of Human Longevity: Inflammation, Nutrition, and Aging in the Evolution of Lifespans , 2007 .

[58]  Ernestine Becker McCollum,et al.  Modern Nutrition in Health and Disease , 1956 .

[59]  I. Huybrechts,et al.  Review and evaluation of innovative technologies for measuring diet in nutritional epidemiology. , 2012, International journal of epidemiology.

[60]  Mingui Sun,et al.  Determination of food portion size by image processing , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  M. Sevick,et al.  Self-monitoring in weight loss: a systematic review of the literature. , 2011, Journal of the American Dietetic Association.

[62]  Behnoosh Hariri,et al.  A personal assistive system for nutrient intake monitoring , 2011, Ubi-MUI '11.

[63]  L. Appel,et al.  Lifestyle Interventions Reduce Coronary Heart Disease Risk: Results From the PREMIER Trial , 2009, Circulation.

[64]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[65]  Caj Södergård,et al.  HyperFit: Hybrid media in personal nutrition and exercise management , 2008, PervasiveHealth.