A novel deep learning neural network for fast-food image classification and prediction using modified loss function

Accurate food image classification is often critical to accurately monitor the dietary assessment to reduce the risk of different heart-related diseases, obesity, diabetes, and other related health conditions. The accuracy and efficiency of image classification results when using traditional deep learning methods were less than optimal. This research aimed at enhancing the classification and prediction accuracy of food images and reducing the processing time by using the Deep Convolutional Neural Network (DCN) algorithm. The solution starts by using the Modified Loss function, the images are fed into the DCN for features extraction through alternating between convolutional layers and pooling layers, then this is followed by a fully connected layer. Finally, the Softmax function is used to classify the images. The result was compared during the classification phase in the DCN. The proposed solution enhanced the accuracy of the classification by using the regularized loss function and lowered the processing time by decreasing the weights of the neurons in the neural network. Probability score is used as the evaluation metric for the accuracy, and total execution time is used as the evaluation metric for the speed of the algorithm. The combination of deep neural network with regularized cross entropy cost function has improved the fast-food images classification by ahcieving better processing time by 40 ~ 50s and accuracy by 5% in average.

[1]  M. Rondanelli,et al.  Elevated Plasma Vitamin B12 Concentrations Are Independent Predictors of In-Hospital Mortality in Adult Patients at Nutritional Risk , 2016, Nutrients.

[2]  Paolo Napoletano,et al.  Food Recognition: A New Dataset, Experiments, and Results , 2017, IEEE Journal of Biomedical and Health Informatics.

[3]  Song-Hai Zhang,et al.  Multi-Task Learning for Food Identification and Analysis with Deep Convolutional Neural Networks , 2016, Journal of Computer Science and Technology.

[4]  Xin Sun,et al.  Chinese Herbal Medicine Image Recognition and Retrieval by Convolutional Neural Network , 2016, PloS one.

[5]  Tome Eftimov,et al.  Mixed deep learning and natural language processing method for fake-food image recognition and standardization to help automated dietary assessment , 2018, Public Health Nutrition.

[6]  W. R. Sam Emmanuel,et al.  Neural network classifier and multiple hypothesis image segmentation for dietary assessment using calorie calculator , 2017 .

[7]  Daniël M Pelt,et al.  A mixed-scale dense convolutional neural network for image analysis , 2017, Proceedings of the National Academy of Sciences.

[8]  Twan van Laarhoven,et al.  L2 Regularization versus Batch and Weight Normalization , 2017, ArXiv.

[9]  Matthieu Guillaumin,et al.  Food-101 - Mining Discriminative Components with Random Forests , 2014, ECCV.

[10]  Keith Dobney,et al.  Earliest “Domestic” Cats in China Identified as Leopard Cat (Prionailurus bengalensis) , 2016, PloS one.

[11]  Ming Che Lee,et al.  A Deep Convolutional Neural Network based Chinese Menu Recognition App , 2017, Inf. Process. Lett..

[12]  Chee Onn Chow,et al.  Image noise types recognition using convolutional neural network with principal components analysis , 2017, IET Image Process..

[13]  Ming-Hsuan Yang,et al.  Deep Object Tracking With Shrinkage Loss , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W R SAM EMMANUEL,et al.  Fuzzy clustering and Whale-based neural network to food recognition and calorie estimation for daily dietary assessment , 2018 .

[15]  Shervin Shirmohammadi,et al.  Mobile Multi-Food Recognition Using Deep Learning , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[16]  Hong Liang,et al.  CEP: calories estimation from food photos , 2020 .

[17]  Qian Zhang,et al.  Research of improving semantic image segmentation based on a feature fusion model , 2020, Journal of Ambient Intelligence and Humanized Computing.

[18]  Huiru Zheng,et al.  Combining deep residual neural network features with supervised machine learning algorithms to classify diverse food image datasets , 2018, Comput. Biol. Medicine.

[20]  Dae-Ki Kang,et al.  Biased Dropout and Crossmap Dropout: Learning towards effective Dropout regularization in convolutional neural network , 2018, Neural Networks.

[21]  B. Koroušić Seljak,et al.  NutriNet: A Deep Learning Food and Drink Image Recognition System for Dietary Assessment , 2017, Nutrients.

[22]  Shigeru Katagiri,et al.  Automatic node selection for Deep Neural Networks using Group Lasso regularization , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Vinod Vokkarane,et al.  A New Deep Learning-Based Food Recognition System for Dietary Assessment on An Edge Computing Service Infrastructure , 2018, IEEE Transactions on Services Computing.

[24]  Amaia Salvador,et al.  Inverse Cooking: Recipe Generation From Food Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jiebo Luo,et al.  Zero-Shot Video Object Segmentation With Co-Attention Siamese Networks , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.