Using Deep Learning for Food and Beverage Image Recognition

Recently, deep learning achieved the state of the art in the field of food image recognition. In this paper we describe our deep learning contributions to the field: NutriNet, a novel deep learning architecture, and a pixel-level classification solution for images of fake food. NutriNet was trained on a food image dataset of a larger size and containing more food classes than previous works, and was the first to recognize beverage images. Our work on fake-food image recognition includes the first automatic system for recognizing images of fake food, while the visual similarity of fake and real food makes it useful for fake-food experiments as well as real food recognition.

[1]  Paolo Napoletano,et al.  Food Recognition: A New Dataset, Experiments, and Results , 2017, IEEE Journal of Biomedical and Health Informatics.

[2]  Lei Yang,et al.  PFID: Pittsburgh fast-food image dataset , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Keiji Yanai,et al.  A food image recognition system with Multiple Kernel Learning , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  Fei Liu,et al.  Application of Deep Learning in Food: A Review. , 2019, Comprehensive reviews in food science and food safety.

[5]  Mei Chen,et al.  Food recognition using statistics of pairwise local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Keiji Yanai,et al.  Food image recognition with deep convolutional features , 2014, UbiComp Adjunct.

[7]  Touradj Ebrahimi,et al.  Food/Non-food Image Classification and Food Categorization using Pre-Trained GoogLeNet Model , 2016, MADiMa @ ACM Multimedia.

[8]  B. Koroušić Seljak,et al.  NutriNet: A Deep Learning Food and Drink Image Recognition System for Dietary Assessment , 2017, Nutrients.

[9]  Tome Eftimov,et al.  Mixed deep learning and natural language processing method for fake-food image recognition and standardization to help automated dietary assessment , 2018, Public Health Nutrition.