Estimating the Composition of Food Nutrients from Hyperspectral Signals Based on Deep Neural Networks

There is an increasing demand for acquiring details of food nutrients especially among those who are sensitive to food intakes and weight changes. To meet this need, we propose a new approach based on deep learning that precisely estimates the composition of carbohydrates, proteins, and fats from hyperspectral signals of foods obtained by using low-cost spectrometers. Specifically, we develop a system consisting of multiple deep neural networks for estimating food nutrients followed by detecting and discarding estimation anomalies. Our comprehensive performance evaluation demonstrates that the proposed system can maximize estimation accuracy by automatically identifying wrong estimations. As such, if consolidated with the capability of reinforcement learning, it will likely be positioned as a promising means for personalized healthcare in terms of food safety.

[1]  Dong Liang,et al.  Fast Prediction of Sugar Content in Dangshan Pear (Pyrus spp.) Using Hyperspectral Imagery Data , 2018, Food Analytical Methods.

[2]  Gol-Naz Arjomand,et al.  Food Pattern, Lifestyle and Diabetes Mellitus , 2014, International journal of high risk behaviors & addiction.

[3]  Yan Li,et al.  Effects of the number of hidden nodes used in a structured-based neural network on the reliability of image classification , 2008, Neural Computing and Applications.

[4]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[5]  Nicola Caporaso,et al.  Non-destructive analysis of sucrose, caffeine and trigonelline on single green coffee beans by hyperspectral imaging , 2018, Food research international.

[6]  Mubarak Shah,et al.  Learning a Deep Model for Human Action Recognition from Novel Viewpoints , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Xiaojiang Chen,et al.  Material Identification and Target Imaging with RFIDs [IoT Connection] , 2018, Computer.

[8]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[9]  S. Gallagher Centrifugation , 2014 .

[10]  Michel J. Anzanello,et al.  Near infrared spectroscopy and element concentration analysis for assessing yerba mate (Ilex paraguariensis) samples according to the country of origin , 2017, Comput. Electron. Agric..

[11]  E. Vardell Global Health Observatory Data Repository , 2020, Medical reference services quarterly.

[12]  Jianhua Li,et al.  Computer vision-based food calorie estimation: dataset, method, and experiment , 2017, ArXiv.

[13]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[14]  Keiji Yanai,et al.  Image-Based Food Calorie Estimation Using Knowledge on Food Categories, Ingredients and Cooking Directions , 2017, ACM Multimedia.

[15]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[16]  Luca Weisz,et al.  Food Analysis Theory And Practice , 2016 .

[17]  Roberto Di Pietro,et al.  Smart health: A context-aware health paradigm within smart cities , 2014, IEEE Communications Magazine.

[18]  Francesca Blum,et al.  High performance liquid chromatography. , 2014, British journal of hospital medicine.

[19]  Jing Wang,et al.  A Folded Neural Network Autoencoder for Dimensionality Reduction , 2012, INNS-WC.

[20]  Randolph M. Beaudry,et al.  Determination of firmness and sugar content of apples using near-infrared diffuse reflectance , 2000 .

[21]  M. S. Fowler,et al.  Hyperspectral imaging for non-destructive prediction of fermentation index, polyphenol content and antioxidant activity in single cocoa beans , 2018, Food chemistry.

[22]  Keiji Yanai,et al.  Simultaneous estimation of food categories and calories with multi-task CNN , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[23]  Zhiguo Wang,et al.  Bilateral Multi-Perspective Matching for Natural Language Sentences , 2017, IJCAI.

[24]  Yu Zhang,et al.  Very deep convolutional networks for end-to-end speech recognition , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[26]  U. K. Jaliya,et al.  A Survey on Object Detection and Tracking Methods , 2014 .

[27]  M. Rosenblatt A CENTRAL LIMIT THEOREM AND A STRONG MIXING CONDITION. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Da-Wen Sun,et al.  Development of an alternative technique for rapid and accurate determination of fish caloric density based on hyperspectral imaging , 2016 .

[29]  Chunxiao Tang,et al.  Multispectral imaging for predicting sugar content of ‘Fuji’ apples , 2018, Optics & Laser Technology.