An Exploration of Deep Transfer Learning for Food Image Classification

Image classification is an important problem in computer vision research and is useful in applications such as content-based image retrieval and automated detection systems. In recent years, extensive research has been conducted in this field to classify different types of images. In this paper, we investigate one such domain, namely, food image classification. Classification of food images is useful in applications such as waiter-less restaurants and dietary intake calculators. To this end, we explore the use of pre-trained deep convolutional neural networks (DCNNs) in two ways. First, we use transfer learning and re-train the DCNNs on food images. Second, we extract features from pre-trained DCNNs to train conventional classifiers. We also introduce a new food image database based on Australian dietary guidelines. We compare the performance of these methods on existing databases and the one introduced here. We show that similar levels of accuracy are obtained in both methods, but the training time for the latter is significantly lower. We also perform a comparison with existing methods and show that the methods explored here are comparably accurate to existing methods.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[3]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Keiji Yanai,et al.  Food image recognition using deep convolutional network with pre-training and fine-tuning , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[7]  Xiangde Zhang,et al.  Feature Extraction and Fusion Using Deep Convolutional Neural Networks for Face Detection , 2017 .

[8]  Buse Melis Ozyildirim,et al.  Comparison of convolutional neural network models for food image classification , 2018, J. Inf. Telecommun..

[9]  Touradj Ebrahimi,et al.  Food/Non-food Image Classification and Food Categorization using Pre-Trained GoogLeNet Model , 2016, MADiMa @ ACM Multimedia.

[10]  K. Curriculum,et al.  Australian Dietary Guidelines , 2006 .

[11]  Huiru Zheng,et al.  Towards Personalised Training of Machine Learning Algorithms for Food Image Classification Using a Smartphone Camera , 2016, UCAmI.

[12]  Ram Gopal Raj,et al.  Recognition of Traffic Sign Based on Bag-of-Words and Artificial Neural Network , 2017, Symmetry.

[13]  Gabriel Taubin,et al.  VeggieVision: a produce recognition system , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[14]  Georg Waltner,et al.  Personalized Dietary Self-Management Using Mobile Vision-Based Assistance , 2017, ICIAP Workshops.

[15]  Keiji Yanai,et al.  Food image recognition with deep convolutional features , 2014, UbiComp Adjunct.

[16]  Kiyoharu Aizawa,et al.  Highly Accurate Food/Non-Food Image Classification Based on a Deep Convolutional Neural Network , 2015, ICIAP Workshops.

[17]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[18]  Buse Melis Ozyildirim,et al.  Comparison of convolutional neural network models for food image classification , 2017, INISTA.

[19]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Kiyoharu Aizawa,et al.  Food log by analyzing food images , 2008, ACM Multimedia.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ram Gopal Raj,et al.  Performance of SVM, CNN, and ANN with BoW, HOG, and Image Pixels in Face Recognition , 2017, 2017 2nd International Conference on Electrical & Electronic Engineering (ICEEE).