Detection of Oil-Containing Dressing on Salad Leaves Using Multispectral Imaging

There is a need for non-invasive methods for nutritional analysis of food that can address the drawbacks of current methods such as color photography, which cannot distinguish between energy-dense and zero calorie foods. This paper discusses a novel, multispectral approach for the identification of oil, particularly in salads, and defines a pseudo-reflectance term. A custom-made multispectral camera was used to collect a novel, publicly shared dataset of images of untreated lettuce leaves or leaves treated with vinegar, oil, or a combination of these. The camera captured image data at 10 wavelengths $\in $ [380nm,980nm] across the electromagnetic spectrum in the visible and NIR (near-infrared) regions. Imaging was done in a lab environment with the presence of ambient light. Mean spectra were extracted from the regions of interest in the multispectral cube and used to compute pseudo-reflectance. ANOVA (Analysis of Variance) was performed to look for variances in the pseudo-reflectance curves. ANOVA proved that the differences between group means of the four treatment groups (oil, vinegar, oil plus vinegar, control) were statistically significant. Pairs of groups showing the greatest significance were established using a Tukey post hoc test. Sequential Forward Selection (SFS) was used to determine 5 optimal feature wavelengths from the whole feature space (410 nm, 455 nm, 485 nm, 810 nm, and 850 nm). A combination of visible (VIS) and infrared (IR) wavelengths, selected using SFS, showed the greatest potential for discrimination between groups containing oil and groups that do not contain oil with a classification accuracy of 84.20%. The pseudo-reflectance values were statistically proven to be sensitive to the presence of oil as a dressing. This research has demonstrated the feasibility of implementing a multispectral imaging technique for identifying the presence of oil in salads and possibly an energy content detection system.

[1]  Benny P. L. Lo,et al.  Food volume estimation for quantifying dietary intake with a wearable camera , 2018, 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[2]  Edward J. Delp,et al.  Food image analysis: Segmentation, identification and weight estimation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Chunxiao Tang,et al.  Multispectral imaging for predicting sugar content of ‘Fuji’ apples , 2018, Optics & Laser Technology.

[4]  Michael R. Neuman,et al.  Energy intake estimation from counts of chews and swallows , 2015, Appetite.

[5]  K. Tu,et al.  Detection of cold injury in peaches by hyperspectral reflectance imaging and artificial neural network. , 2016, Food chemistry.

[6]  A. Montes de Oca,et al.  Low-cost multispectral imaging system for crop monitoring , 2018, 2018 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Gregory D. Abowd,et al.  EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[8]  Yousef Al-Ohali,et al.  Computer vision based date fruit grading system: Design and implementation , 2011, J. King Saud Univ. Comput. Inf. Sci..

[9]  O. Makeyev,et al.  Detection of Food Intake from Swallowing Sequences by Supervised and Unsupervised Methods , 2010, Annals of Biomedical Engineering.

[10]  Mingui Sun,et al.  Accuracy of food portion size estimation from digital pictures acquired by a chest-worn camera , 2013, Public Health Nutrition.

[11]  Mahmood Reza Golzarian,et al.  Detection and classification of citrus green mold caused by Penicillium digitatum using multispectral imaging. , 2018, Journal of the science of food and agriculture.

[12]  Da-Wen Sun,et al.  Multispectral Imaging for Plant Food Quality Analysis and Visualization. , 2018, Comprehensive reviews in food science and food safety.

[13]  Jianwei Qin,et al.  Measurement of the Absorption and Scattering Properties of Turbid Liquid Foods Using Hyperspectral Imaging , 2007, Applied spectroscopy.

[14]  Fernando López-García,et al.  Automatic detection of skin defects in citrus fruits using a multivariate image analysis approach , 2010 .

[15]  X. Liu,et al.  A Method of High Throughput Monitoring Crop Physiology Using Chlorophyll Fluorescence and Multispectral Imaging , 2018, Front. Plant Sci..

[16]  J. C. Noordam,et al.  Detection and classification of latent defects and diseases on raw French fries with multispectral imaging , 2005 .

[17]  J. Higgins,et al.  Meal Microstructure Characterization from Sensor-Based Food Intake Detection , 2017, Front. Nutr..

[18]  Liang Gong,et al.  Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier , 2015 .

[19]  Efstathios Z. Panagou,et al.  Multispectral image analysis approach to detect adulteration of beef and pork in raw meats , 2015 .

[20]  Adam W. Hoover,et al.  A New Method for Measuring Meal Intake in Humans via Automated Wrist Motion Tracking , 2012, Applied Psychophysiology and Biofeedback.

[21]  B. Koroušić Seljak,et al.  NutriNet: A Deep Learning Food and Drink Image Recognition System for Dietary Assessment , 2017, Nutrients.

[22]  Joachim Nwezeobi,et al.  A method for real-time classification of insect vectors of mosaic and brown streak disease in cassava plants for future implementation within a low-cost, handheld, in-field multispectral imaging sensor , 2018, Plant Methods.

[23]  Edward Sazonov,et al.  Segmentation and Characterization of Chewing Bouts by Monitoring Temporalis Muscle Using Smart Glasses With Piezoelectric Sensor , 2017, IEEE Journal of Biomedical and Health Informatics.

[24]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[25]  Cyrill Stachniss,et al.  WeedMap: A large-scale semantic weed mapping framework using aerial multispectral imaging and deep neural network for precision farming , 2018, Remote. Sens..

[26]  Daniel I. Onwude,et al.  Evaluation of Chilling Injury in Mangoes Using Multispectral Imaging. , 2018, Journal of food science.

[27]  Yousef Al Ohali,et al.  Original Article: Computer vision based date fruit grading system: Design and implementation , 2011 .

[28]  Bim Prasad Shrestha,et al.  Integrating multispectral reflectance and fluorescence imaging for defect detection on apples , 2006 .

[29]  Jasper G. Tallada,et al.  Bruise Detection using NIR Hyperspectral Imaging for Strawberry (Fragaria * ananassa Duch.) , 2006 .

[30]  Nathaniel J. C. Libatique,et al.  UAV imaging with low-cost multispectral imaging system for precision agriculture applications , 2017, 2017 IEEE Global Humanitarian Technology Conference (GHTC).

[31]  Gerrit Polder,et al.  Hyperspectral image analysis for measuring ripeness of tomatoes. , 2000 .

[32]  Changhong Liu,et al.  Potential of multispectral imaging combined with chemometric methods for rapid detection of sucrose adulteration in tomato paste , 2017 .

[33]  Santosh Shrestha,et al.  Multispectral imaging – a new tool in seed quality assessment? , 2018, Seed Science Research.

[34]  Wenyao Xu,et al.  Wearable Food Intake Monitoring Technologies: A Comprehensive Review , 2017, Comput..

[35]  Xin Yang,et al.  Statistical models for meal-level estimation of mass and energy intake using features derived from video observation and a chewing sensor , 2019, Scientific Reports.

[36]  Oleksandr Makeyev,et al.  Automatic identification of the number of food items in a meal using clustering techniques based on the monitoring of swallowing and chewing , 2012, Biomed. Signal Process. Control..

[37]  Renfu Lu,et al.  Prediction of firmness and soluble solids content of blueberries using hyperspectral reflectance imaging , 2013 .

[38]  P. Martinsen,et al.  Measuring soluble solids distribution in kiwifruit using near-infrared imaging spectroscopy , 1998 .

[39]  Yue Cao,et al.  Rapid and non-destructive identification of water-injected beef samples using multispectral imaging analysis. , 2016, Food chemistry.

[40]  Marco Ricci,et al.  Multispectral laser imaging for advanced food analysis , 2016 .

[41]  Edward Sazonov,et al.  A Novel Wearable Device for Food Intake and Physical Activity Recognition , 2016, Sensors.

[42]  Maysam Ghovanloo,et al.  Unobtrusive and Wearable Systems for Automatic Dietary Monitoring , 2017, IEEE Transactions on Biomedical Engineering.

[43]  Wei Liu,et al.  Nondestructive determination of transgenic Bacillus thuringiensis rice seeds (Oryza sativa L.) using multispectral imaging and chemometric methods. , 2014, Food chemistry.

[44]  Gerhard Tröster,et al.  Detection of eating and drinking arm gestures using inertial body-worn sensors , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[45]  J. Sugiyama Visualization of sugar content in the flesh of a melon by near-infrared imaging. , 1999, Journal of agricultural and food chemistry.

[46]  Oliver Amft,et al.  Diet eyeglasses: Recognising food chewing using EMG and smart eyeglasses , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[47]  D. P. Ariana,et al.  Evaluation of internal defect and surface color of whole pickles using hyperspectral imaging. , 2010 .

[48]  G. Downey,et al.  Characterization of Near-Infrared Spectral Variance in the Authentication of Skim and Nonfat Dry Milk Powder Collection Using ANOVA-PCA, Pooled-ANOVA, and Partial Least-Squares Regression , 2014, Journal of agricultural and food chemistry.