Fusion of electronic nose, electronic tongue and computer vision for animal source food authentication and quality assessment – A review

Electronic nose, electronic tongue and computer vision systems, designed to artificially perceive flavour and appearance, have been increasingly used in the food industry as rapid and reliable tools for quality assessment. The use of multivariate analysis methods, together with electronic senses, has shown to be very powerful; however, due to the high complexity of food, the employment of just single sensor data is often insufficient. In recent years, much research has been performed to develop several data fusion strategies, combining the outputs of multiple instrumental sources, for improving the quality assessment and authentication of food. The aim of this work is to review the recent achievements in the field of artificial sensors’ application, in the evaluation of animal source food products.

[1]  Peng Liu,et al.  Prediction of TVB-N content in eggs based on electronic nose , 2012 .

[2]  Liping Ren,et al.  Evaluation of Beef by Electronic Tongue System TS-5000Z: Flavor Assessment, Recognition and Chemical Compositions According to Its Correlation with Flavor , 2015, PloS one.

[3]  Yankun Peng,et al.  A machine vision system for identification of micro-crack in egg shell , 2012 .

[4]  L. M. Kamarudin,et al.  Bio-inspired taste assessment of pure and adulterated honey using multi-sensing technique , 2014, 2014 2nd International Conference on Electronic Design (ICED).

[5]  M. Chmiel,et al.  The use of computer vision system to detect pork defects , 2016 .

[6]  Jing Xie,et al.  Predicting shelf-life of chilled pork sold in China , 2013 .

[7]  Eduard Llobet,et al.  Aging time and brand determination of pasteurized milk using a multisensor e-nose combined with a voltammetric e-tongue. , 2014, Materials science & engineering. C, Materials for biological applications.

[8]  Hong-mei Sun,et al.  Changes of flavor compounds of hydrolyzed chicken bone extracts during Maillard reaction. , 2014, Journal of food science.

[9]  Qiang Cai,et al.  Rapid Classification of Hairtail Fish and Pork Freshness Using an Electronic Nose Based on the PCA Method , 2011, Sensors.

[10]  Mahdi Ghasemi-Varnamkhasti,et al.  Potential application of electronic nose technology in brewery , 2011 .

[11]  Kaiqi Su,et al.  Recent achievements in electronic tongue and bioelectronic tongue as taste sensors , 2015 .

[12]  Paulina Wiśniewska,et al.  Food analysis using artificial senses. , 2014, Journal of agricultural and food chemistry.

[13]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  E. Schaller,et al.  ‘Electronic Noses’ and Their Application to Food , 1998 .

[15]  James A. Covington,et al.  Electronic mucosa: A natural successor to the electronic nose system? , 2012 .

[16]  E. Llobet,et al.  Monitoring of physical–chemical and microbiological changes in fresh pork meat under cold storage by means of a potentiometric electronic tongue , 2011 .

[17]  Hyun Seok Song,et al.  Single‐Carbon‐Atomic‐Resolution Detection of Odorant Molecules using a Human Olfactory Receptor‐based Bioelectronic Nose , 2009 .

[18]  Anders Krogh Mortensen,et al.  Weight prediction of broiler chickens using 3D computer vision , 2016, Comput. Electron. Agric..

[19]  Lei Liu,et al.  Feature selection with dynamic mutual information , 2009, Pattern Recognit..

[20]  Pierantonio Facco,et al.  Data Fusion for Food Authentication: Fresh/Frozen–Thawed Discrimination in West African Goatfish (Pseudupeneus prayensis) Fillets , 2013, Food and Bioprocess Technology.

[21]  Zulfiqur Ali,et al.  Chemical Sensors for Electronic Nose Systems , 2005 .

[22]  Di Wu,et al.  Colour measurements by computer vision for food quality control – A review , 2013 .

[23]  Tai Hyun Park,et al.  Bioelectronic nose with high sensitivity and selectivity using chemically functionalized carbon nanotube combined with human olfactory receptor. , 2012, Journal of biotechnology.

[24]  Shannon E. Stitzel,et al.  Cross-reactive chemical sensor arrays. , 2000, Chemical reviews.

[25]  R. Gutierrez-Osuna,et al.  Fusion of three sensory modalities for the multimodal characterization of red wines , 2004, IEEE Sensors Journal.

[26]  E. Bruneau,et al.  Sensory analysis applied to honey: state of the art , 2004 .

[27]  H. Abdi.  Partial least squares regression and projection on latent structure regression (PLS Regression) , 2010 .

[28]  Vassilis S. Kodogiannis.  A Rapid Detection of Meat Spoilage Using an Electronic Nose and Fuzzy-Wavelet Systems , 2016 .

[29]  Fangkai Han,et al.  Nondestructive detection of fish freshness during its preservation by combining electronic nose and electronic tongue techniques in conjunction with chemometric analysis , 2014 .

[30]  K. J. Hsia,et al.  Bioinspired Smell and Taste Sensors , 2015, Springer Netherlands.

[31]  George-John E. Nychas,et al.  Sensory and microbiological quality assessment of beef fillets using a portable electronic nose in tandem with support vector machine analysis , 2013 .

[32]  Xichang Wang,et al.  Prediction of total viable counts on chilled pork using an electronic nose combined with support vector machine. , 2012, Meat science.

[33]  Daoliang Li,et al.  Fish species classification by color, texture and multi-class support vector machine using computer vision , 2012 .

[34]  Ya-li Dang,et al.  Comparison of umami taste peptides in water-soluble extractions of Jinhua and Parma hams , 2015 .

[35]  Sajad Kiani,et al.  Fusion of artificial senses as a robust approach to food quality assessment , 2016 .

[36]  Ricardo Gutierrez-Osuna,et al.  The how and why of electronic noses , 1998 .

[37]  Ammar Zakaria,et al.  A Hybrid Sensing Approach for Pure and Adulterated Honey Classification , 2012, Sensors.

[38]  Kang Tu,et al.  Eggshell crack detection based on computer vision and acoustic response by means of back-propagation artificial neural network , 2011 .

[39]  A.J.M. Timmermans.  COMPUTER VISION SYSTEM FOR ON-LINE SORTING OF POT PLANTS BASED ON LEARNING TECHNIQUES , 1998 .

[40]  Julian W. Gardner,et al.  A brief history of electronic noses , 1994 .

[41]  Qingling Wang,et al.  Discriminating eggs from different poultry species by fatty acids and volatiles profiling: Comparison of SPME‐GC/MS, electronic nose, and principal component analysis method , 2014 .

[42]  Da-Wen Sun,et al.  Inspecting pizza topping percentage and distribution by a computer vision method , 2000 .

[43]  Tai Hyun Park,et al.  Ultrasensitive flexible graphene based field-effect transistor (FET)-type bioelectronic nose. , 2012, Nano letters.

[44]  Patrycja Ciosek,et al.  Potentiometric Electronic Tongues for Foodstuff and Biosample Recognition—An Overview , 2011, Sensors.

[45]  Astrid Hilding-Ohlsson,et al.  Voltamperometric Discrimination of Urea and Melamine Adulterated Skimmed Milk Powder , 2012, Sensors.

[46]  Mahmoud Omid,et al.  Egg volume prediction using machine vision technique based on pappus theorem and artificial neural network , 2015, Journal of Food Science and Technology.

[47]  Tai Hyun Park,et al.  Bioelectronic Nose: An Emerging Tool for Odor Standardization. , 2017, Trends in biotechnology.

[48]  Miguel Peris,et al.  On-line monitoring of food fermentation processes using electronic noses and electronic tongues: a review. , 2013, Analytica chimica acta.

[49]  Bosoon Park,et al.  Characterizing Multispectral Images of Tumorous, Bruised, Skin-torn, and Wholesome Poultry Carcasses , 1996 .

[50]  Feng Chen,et al.  Contribution of chicken base addition to aroma characteristics of Maillard reaction products based on gas chromatography-mass spectrometry, electronic nose, and statistical analysis , 2015, Food Science and Biotechnology.

[51]  F. Napolitano,et al.  Image analysis with the computer vision system and the consumer test in evaluating the appearance of Lucanian dry sausage. , 2014, Meat science.

[52]  George-John E. Nychas,et al.  Ensemble-based support vector machine classifiers as an efficient tool for quality assessment of beef fillets from electronic nose data , 2016 .

[53]  Saeid Minaei,et al.  Honey characterization using computer vision system and artificial neural networks. , 2014, Food chemistry.

[54]  Rui Guerra,et al.  Determination of the botanical origin of honey by sensor fusion of impedance e-tongue and optical spectroscopy , 2013 .

[55]  Abdul Hamid Adom,et al.  A Biomimetic Sensor for the Classification of Honeys of Different Floral Origin and the Detection of Adulteration , 2011, Sensors.

[56]  Zhenbo Wei,et al.  Tracing floral and geographical origins of honeys by potentiometric and voltammetric electronic tongue , 2014 .

[57]  Mirosław Słowiński,et al.  Lightness of the color measured by computer image analysis as a factor for assessing the quality of pork meat. , 2011, Meat science.

[58]  Tai Hyun Park,et al.  A bioelectronic sensor based on canine olfactory nanovesicle-carbon nanotube hybrid structures for the fast assessment of food quality. , 2012, The Analyst.

[59]  K. J. Chen,et al.  Predicting Fresh Beef Color Grade Using Machine Vision Imaging and Support Vector Machine (SVM) Analysis , 2011 .

[60]  Dan Liu,et al.  Applications of Computer Vision for Assessing Quality of Agri-food Products: A Review of Recent Research Advances , 2016, Critical reviews in food science and nutrition.

[61]  Junita Mohamad Saleh,et al.  Fusion Technique for Honey Purity Estimation using Artificial Neural Network , 2014 .

[62]  K. Hayashi,et al.  Multichannel taste sensor using lipid membranes , 1990 .

[63]  Tai Hyun Park,et al.  Nanovesicle-based bioelectronic nose platform mimicking human olfactory signal transduction. , 2012, Biosensors & bioelectronics.

[64]  Ricard Boqué,et al.  Data fusion methodologies for food and beverage authentication and quality assessment - a review. , 2015, Analytica chimica acta.

[65]  Oh Seok Kwon,et al.  Polypyrrole nanotubes conjugated with human olfactory receptors: high-performance transducers for FET-type bioelectronic noses. , 2009, Angewandte Chemie.

[66]  M. Chmiel,et al.  Application of computer vision systems for estimation of fat content in poultry meat , 2011 .

[67]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[68]  A. Wadehra,et al.  Application of electronic tongues in food processing , 2016 .

[69]  Hongbin Pu,et al.  Model improvement for predicting moisture content (MC) in pork longissimus dorsi muscles under diverse processing conditions by hyperspectral imaging , 2017 .

[70]  A. S. Mohamed,et al.  Rapid identification of pork for halal authentication using the electronic nose and gas chromatography mass spectrometer with headspace analyzer. , 2011, Meat science.

[71]  Peter Chr. Lorenzen,et al.  Development of a method for butter type differentiation by electronic nose technology , 2013 .

[72]  M. Balaban,et al.  Quantification of gaping, bruising, and blood spots in salmon fillets using image analysis. , 2011, Journal of food science.

[73]  Constantin Apetrei,et al.  Application of voltammetric e-tongue for the detection of ammonia and putrescine in beef products , 2016 .

[74]  Lei Wu,et al.  A data fusion detection method for fish freshness based on computer vision and near-infrared spectroscopy , 2016 .

[75]  A. Izenman.  Linear Discriminant Analysis , 2013 .

[76]  N. Bârsan,et al.  Electronic nose: current status and future trends. , 2008, Chemical reviews.

[77]  Futoshi Kobayashi,et al.  Development of Food Texture Sensor Using Two Magnetic Sensing Elements , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[78]  Dah-Jye Lee,et al.  An efficient shape analysis method for shrimp quality evaluation , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[79]  T. Florowski,et al.  Use of computer vision system (CVS) for detection of PSE pork meat obtained from m. semimembranosus , 2016 .

[80]  Constantin Apetrei,et al.  Fish Freshness Monitoring Using an E-Tongue Based on Polypyrrole Modified Screen-Printed Electrodes , 2013, IEEE Sensors Journal.

[81]  K Neely,et al.  Assessment of cooked alpaca and llama meats from the statistical analysis of data collected using an 'electronic nose'. , 2001, Meat science.

[82]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[83]  Poonpat Poonnoy,et al.  Classification of Boiled Shrimp's Shape Using Image Analysis and Artificial Neural Network Model , 2014 .

[84]  Fredrik Winquist,et al.  Performance of an electronic nose for quality estimation of ground meat , 1993 .

[85]  S. Esposto,et al.  Consumer acceptability of ovine cheese from ewes fed extruded linseed-enriched diets , 2012 .

[86]  Bipan Tudu,et al.  A review on combined odor and taste sensor systems , 2016 .

[87]  K. Hwang,et al.  Effects of kimchi and smoking on quality characteristics and shelf life of cooked sausages prepared with irradiated pork. , 2014, Meat science.

[88]  Nuria Aleixos,et al.  Erratum to: Advances in Machine Vision Applications for Automatic Inspection and Quality Evaluation of Fruits and Vegetables , 2011 .

[89]  Ganesh Kumar Mani,et al.  Electronic noses for food quality : a review , 2015 .

[90]  IMPROVED PERFORMANCE OF THE AROMASCAN A32S ELECTRONIC NOSE AND ITS POTENTIAL FOR DETECTING AROMA DIFFERENCES IN DAIRY PRODUCTS , 1998 .

[91]  C Cevoli,et al.  Classification of Pecorino cheeses using electronic nose combined with artificial neural network and comparison with GC-MS analysis of volatile compounds. , 2011, Food chemistry.

[92]  S. Mustafa,et al.  Optimization of textural properties and formulation of reduced fat Cheddar cheeses containing fat replacers , 2012 .

[93]  A. Smilde,et al.  On the increase of predictive performance with high-level data fusion. , 2011, Analytica Chimica Acta.

[94]  Bo Zhang,et al.  Application of Electronic Nose with Multivariate Analysis and Sensor Selection for Botanical Origin Identification and Quality Determination of Honey , 2015, Food and Bioprocess Technology.

[95]  Jun-Hu Cheng,et al.  Suitability of hyperspectral imaging for rapid evaluation of thiobarbituric acid (TBA) value in grass carp (Ctenopharyngodon idella) fillet. , 2015, Food chemistry.

[96]  Mahmoud Omid,et al.  An expert egg grading system based on machine vision and artificial intelligence techniques , 2013 .

[97]  Zhang Min,et al.  Colour vision in forest and wood engineering. , 2000 .

[98]  Xichang Wang,et al.  Species Discrimination among Three Kinds of Puffer Fish Using an Electronic Nose Combined with Olfactory Sensory Evaluation , 2012, Sensors.

[99]  C. Chai,et al.  A model for discrimination freshness of shrimp , 2015 .

[100]  Alphus D. Wilson,et al.  Applications and Advances in Electronic-Nose Technologies , 2009, Sensors.

[101]  Minghui Zhu,et al.  Using sensor and spectral analysis to classify botanical origin and determine adulteration of raw honey , 2016 .

[102]  Andrés Caro,et al.  Including 3D-textures in a Computer Vision System to Analyze Quality Traits of Loin , 2015, ICVS.

[103]  Julian W. Gardner,et al.  Monitoring of Fish Freshness Using Tin Oxide Sensors , 1992 .

[104]  Zhenjie Xiong,et al.  Quantitative determination of total pigments in red meats using hyperspectral imaging and multivariate analysis. , 2015, Food chemistry.

[105]  Magni Martens,et al.  Application of an electronic nose system for prediction of sensory quality changes of a meat product (pizza topping) during storage , 2007 .

[106]  Mahmoud Omid,et al.  Freshness assessment of gilthead sea bream (Sparus aurata) by machine vision based on gill and eye color changes , 2013 .

[107]  Xin Sun,et al.  Prediction of pork color attributes using computer vision system. , 2016, Meat science.

[108]  Shaoqing Cui,et al.  Analysis of pork adulteration in minced mutton using electronic nose of metal oxide sensors , 2013 .

[109]  B. Debska,et al.  Application of artificial neural network in food classification. , 2011, Analytica chimica acta.

[110]  Miaoyun Li,et al.  Application of Electronic Nose for Measuring Total Volatile Basic Nitrogen and Total Viable Counts in Packaged Pork During Refrigerated Storage. , 2016, Journal of food science.

[111]  J. Bosset,et al.  The electronic nose applied to dairy products: a review , 2003 .

[112]  Jun Wang,et al.  Monitoring of quality and storage time of unsealed pasteurized milk by voltammetric electronic tongue , 2013 .

[113]  H. B. Mitchell,et al.  Multi-Sensor Data Fusion: An Introduction , 2007 .

[114]  Patrycja Ciosek,et al.  Sensor arrays for liquid sensing--electronic tongue systems. , 2007, The Analyst.

[115]  K. A. Tarbell,et al.  A COMPUTER VISION SYSTEM FOR CHARACTERIZING CORN GROWTH AND DEVELOPMENT , 1991 .

[116]  Zhenbo Wei,et al.  Monitoring the fermentation, post-ripeness and storage processes of set yogurt using voltammetric electronic tongue , 2017 .

[117]  M. Peris,et al.  Review: highlights in recent applications of electronic tongues in food analysis. , 2010, Analytica chimica acta.

[118]  Jiewen Zhao,et al.  Nondestructive measurement of total volatile basic nitrogen (TVB-N) in pork meat by integrating near infrared spectroscopy, computer vision and electronic nose techniques. , 2014, Food chemistry.

[119]  Rasmus Larsen,et al.  Vision-based method for tracking meat cuts in slaughterhouses. , 2014, Meat science.

[120]  Tai Hyun Park,et al.  Mimicking the human smell sensing mechanism with an artificial nose platform. , 2012, Biomaterials.

[121]  José M. Barat,et al.  Use of the voltammetric tongue in fresh cod (Gadus morhua) quality assessment , 2013 .

[122]  Eduardo García-Breijo,et al.  Artificial neural networks (Fuzzy ARTMAP) analysis of the data obtained with an electronic tongue applied to a ham-curing process with different salt formulations , 2015, Appl. Soft Comput..

[123]  S. Alegret,et al.  Voltammetric Electronic Tongue in the Analysis of Cava Wines , 2011 .

[124]  Ping Wang,et al.  Electronic Nose and Electronic Tongue , 2015 .

[125]  I A Basheer,et al.  Artificial neural networks: fundamentals, computing, design, and application. , 2000, Journal of microbiological methods.

[126]  K. Persaud,et al.  Analysis of discrimination mechanisms in the mammalian olfactory system using a model nose , 1982, Nature.

[127]  R T Marsili,et al.  SPME-MS-MVA as an electronic nose for the study of off-flavors in milk. , 1999, Journal of agricultural and food chemistry.

[128]  R. Ramesh,et al.  External and Internal Defect Detection of Egg using Machine Vision , 2013 .

[129]  Eva Domenech,et al.  A potentiometric electronic tongue for the discrimination of honey according to the botanical origin. Comparison with traditional methodologies: Physicochemical parameters and volatile profile , 2012 .

[130]  Kiyoshi Toko,et al.  Taste Sensor: Electronic Tongue with Global Selectivity , 2016 .

[131]  Alphus D. Wilson,et al.  Detection of Off-Flavor in Catfish Using a Conducting Polymer Electronic-Nose Technology , 2013, Sensors.

[132]  Khizar Hayat,et al.  Rapid measuring and modelling flavour quality changes of oxidised chicken fat by electronic nose profiles through the partial least squares regression analysis. , 2013, Food chemistry.

[133]  Mahdi Ghasemi-Varnamkhasti,et al.  Electronic nose and electronic mucosa as innovative instruments for real-time monitoring of food dryers , 2014 .

[134]  Fabio Napolitano,et al.  Measurement of meat color using a computer vision system. , 2013, Meat science.

[135]  Zhenbo Wei,et al.  Detection of antibiotic residues in bovine milk by a voltammetric electronic tongue system. , 2011, Analytica chimica acta.

[136]  Zhenjie Xiong,et al.  Non-destructive prediction of thiobarbituricacid reactive substances (TBARS) value for freshness evaluation of chicken meat using hyperspectral imaging. , 2015, Food chemistry.

[137]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[138]  Chengjie Ma,et al.  Flavour Analysis of Stirred Yoghurt with Cheddar Cheese Adding into Milk , 2014 .

[139]  J. Saja,et al.  Evaluation of the polyphenolic content of extra virgin olive oils using an array of voltammetric sensors , 2008 .

[140]  S. Buratti,et al.  Characterization and differentiation of Italian Parma, San Daniele and Toscano dry-cured hams: a multi-disciplinary approach. , 2014, Meat science.

[141]  Akihiro Ikeda,et al.  Development of a Portable Taste Sensor with a Lipid/Polymer Membrane , 2013, Sensors.

[142]  Sundaram Gunasekaran,et al.  Computer vision technology for food quality assurance , 1996 .

[143]  Huan Cheng,et al.  Geographical origin identification of propolis using GC–MS and electronic nose combined with principal component analysis , 2013 .

[144]  Lu Wang,et al.  Potential of hyperspectral imaging for rapid prediction of hydroxyproline content in chicken meat. , 2015, Food chemistry.

[145]  A. D'Amico,et al.  A sensorial platform for mozzarella cheese characterization and authentication , 2015, 2015 XVIII AISEM Annual Conference.

[146]  I. González-Martín,et al.  Differentiation of products derived from Iberian breed swine by electronic olfactometry (electronic nose). , 2000 .

[147]  Botshabelo Kealesitse,et al.  Exploring the Influence of Quality and Safety on Consumers’ Food Purchase Decisions in Botswana , 2012 .

[148]  I. Lundström,et al.  An electronic tongue based on voltammetry , 1997 .

[149]  Jun Wang,et al.  Evaluation of varieties of set yogurts and their physical properties using a voltammetric electronic tongue based on various potential waveforms , 2013 .

[150]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[151]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[152]  Abdul Hamid Adom,et al.  Enhancing Classification Performance of Multisensory Data through Extraction and Selection of Features , 2012 .

[153]  Daniel Cozzolino,et al.  Instrumental methods (spectroscopy, electronic nose, and tongue) as tools to predict taste and aroma in beverages: advantages and limitations. , 2013, Chemical reviews.

[154]  Soleiman Hosseinpour,et al.  Application of computer vision technique for on-line monitoring of shrimp color changes during drying , 2013 .