Fast auto-clean CNN model for online prediction of food materials

Abstract Online food image detection is a key issue for intelligent food materials receiving and food supply chain applications, how to efficiently, accurately and quickly detect the image of food materials is a challenging research topic. A fast auto-clean convolutional neural network (CNN) model for online prediction of food materials is proposed, which is aiming at problems of the complex characteristics of the food images such as the complexity of the food materials, the focus of the dislocation and the uniformity of illumination. Firstly, a new approach of the auto-clean CNN models is proposed for automatic image cleaning and classification, which starting from original images and ending with multi-class prediction of clean images. Given a vocabulary of K classes, and a Yes/No clean label, two CNN models will learn a class label and a clean label respectively. Secondly, after the forward pass of two CNN models, the joint features generated from the last convolutional layers will be fed into our two loss layers. Combined with multi-class classification method, it classifies and optimizes the image dataset intelligently. Finally, an online prediction algorithm is proposed to improve the image recognition efficiency. Experimental results show that the proposed model and algorithm have good efficiency and accuracy, and the results of this study have significance to optimize the efficiency of the food supply chain industry and food quality evaluation.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Abdenour Hadid,et al.  Multi scale multi descriptor local binary features and exponential discriminant analysis for robust face authentication , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Age K. Smilde,et al.  Principal Component Analysis , 2003, Encyclopedia of Machine Learning.

[4]  Kristen Grauman,et al.  Decorrelating Semantic Visual Attributes by Resisting the Urge to Share , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Roland Siegwart,et al.  A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM , 2014, ICRA 2014.

[6]  Nina Knoll,et al.  Planning and self-efficacy interventions encouraging replacing energy-dense foods intake with fruit and vegetable: A longitudinal experimental study , 2016, Psychology & health.

[7]  Xian-Sheng Hua,et al.  Two-Dimensional Active Learning for image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Sanjay Gambhir,et al.  Evaluation of single-photon emission computed tomography images obtained with and without copper filter by segmentation , 2016, Indian journal of nuclear medicine : IJNM : the official journal of the Society of Nuclear Medicine, India.

[9]  Hal Daumé,et al.  Infinite Predictor Subspace Models for Multitask Learning , 2010, AISTATS.

[10]  Chee Hau Leow,et al.  Flow Velocity Mapping Using Contrast Enhanced High-Frame-Rate Plane Wave Ultrasound and Image Tracking: Methods and Initial in Vitro and in Vivo Evaluation. , 2015, Ultrasound in medicine & biology.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Jieping Ye,et al.  Robust multi-task feature learning , 2012, KDD.

[13]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[14]  Gabriel Taubin,et al.  VeggieVision: a produce recognition system , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[15]  Lei Ma,et al.  Training set size, scale, and features in Geographic Object-Based Image Analysis of very high resolution unmanned aerial vehicle imagery , 2015 .

[16]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[17]  Jun Zhu,et al.  Bayesian Max-margin Multi-Task Learning with Data Augmentation , 2014, ICML.

[18]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Marcin Korytkowski,et al.  Fast image classification by boosting fuzzy classifiers , 2016, Inf. Sci..

[20]  Yudong Zhang,et al.  Classification of Fruits Using Computer Vision and a Multiclass Support Vector Machine , 2012, Sensors.

[21]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Geert Verhoeven,et al.  PIXEL-LEVEL IMAGE FUSION FOR ARCHAEOLOGICAL INTERPRETATIVE MAPPING , 2016 .

[23]  Qiang Chen,et al.  Robust noise region-based active contour model via local similarity factor for image segmentation , 2017, Pattern Recognit..

[24]  Thomas Brox,et al.  Techniques for Gradient-Based Bilevel Optimization with Non-smooth Lower Level Problems , 2016, Journal of Mathematical Imaging and Vision.

[25]  Philip H. S. Torr,et al.  BING: Binarized normed gradients for objectness estimation at 300fps , 2014, Computational Visual Media.

[26]  Shervin Shirmohammadi,et al.  Measuring Calorie and Nutrition From Food Image , 2014, IEEE Transactions on Instrumentation and Measurement.

[27]  V. Lapenna,et al.  Electrical resistivity tomography technique for landslide investigation: A review , 2014 .

[28]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[29]  Jon Atli Benediktsson,et al.  Multilevel Image Segmentation Based on Fractional-Order Darwinian Particle Swarm Optimization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Yangqing Jia,et al.  Deep Convolutional Ranking for Multilabel Image Annotation , 2013, ICLR.

[32]  Qiang Zhou,et al.  Learning to Share Latent Tasks for Action Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[33]  Zhaokai Meng,et al.  Precise Determination of Brillouin Scattering Spectrum Using a Virtually Imaged Phase Array (VIPA) Spectrometer and Charge-Coupled Device (CCD) Camera , 2016, Applied spectroscopy.

[34]  Samy Bengio,et al.  Large-Scale Object Classification Using Label Relation Graphs , 2014, ECCV.

[35]  N. deSouza,et al.  MAGNETIC RESONANCE IMAGING IN PROSTATE CANCER : VALUE OF APPARENT DIFFUSION COEFFICIENTS FOR IDENTIFYING MALIGNANT NODULES , 2010 .

[36]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[37]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.

[38]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[39]  Yanan Wang,et al.  A hybrid approach for the evaluation of supermarket food safety , 2014 .

[40]  C. Lascala,et al.  Analysis of the accuracy of linear measurements obtained by cone beam computed tomography (CBCT-NewTom). , 2004, Dento maxillo facial radiology.

[41]  Jeff G. Schneider,et al.  Learning Multiple Tasks with a Sparse Matrix-Normal Penalty , 2010, NIPS.

[42]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[43]  Li-Rong Zheng,et al.  An Internet-of-Things solution for food safety and quality control: A pilot project in China , 2016, J. Ind. Inf. Integr..

[44]  David A. Forsyth,et al.  Describing objects by their attributes , 2009, CVPR.

[45]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[46]  Ming Yang,et al.  Multi-Task Learning with Gaussian Matrix Generalized Inverse Gaussian Model , 2013, ICML.

[47]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[48]  Yuxin Peng,et al.  The application of two-level attention models in deep convolutional neural network for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Qiang Chen,et al.  Value-centric design of the internet-of-things solution for food supply chain: Value creation, sensor portfolio and information fusion , 2012, Information Systems Frontiers.

[50]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  C. V. Jawahar,et al.  Relative Parts: Distinctive Parts for Learning Relative Attributes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Lihi Zelnik-Manor,et al.  Large Scale Max-Margin Multi-Label Classification with Priors , 2010, ICML.