Deep Nearest Class Mean Model for Incremental Odor Classification

In recent years, more machine learning algorithms have been applied to odor classification. These odor classification algorithms usually assume that the training data sets are static. However, for some odor recognition tasks, new odor classes continually emerge. That is, the odor data sets are dynamically growing while both training samples and number of classes are increasing over time. Motivated by this concern, this paper proposes a deep nearest class mean (DNCM) model based on the deep learning framework and the nearest class mean method. The proposed model not only leverages deep neural network to extract deep features but also able to dynamically integrate new classes over time. In our experiments, the DNCM model was initially trained with 10 classes, then 25 new classes are integrated. Experiment results demonstrate that the proposed model is very efficient for incremental odor classification, especially for new classes with only a small number of training examples.

[1]  A. Gutierrez-Galvez,et al.  Signal and Data Processing for Machine Olfaction and Chemical Sensing: A Review , 2012, IEEE Sensors Journal.

[2]  Sung-Bae Cho,et al.  A probabilistic multi-class strategy of one-vs.-rest support vector machines for cancer classification , 2008, Neurocomputing.

[3]  Fei-Fei Li,et al.  Combining randomization and discrimination for fine-grained image categorization , 2011, CVPR 2011.

[4]  Ming Zeng,et al.  A Flying Odor Compass to Autonomously Locate the Gas Source , 2018, IEEE Transactions on Instrumentation and Measurement.

[5]  Gabriela Csurka,et al.  Distance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Nabarun Bhattacharyya,et al.  Electronic Nose for Black Tea Classification and Correlation of Measurements With “Tea Taster” Marks , 2008, IEEE Transactions on Instrumentation and Measurement.

[7]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[8]  Yoshua Bengio,et al.  A Character-level Decoder without Explicit Segmentation for Neural Machine Translation , 2016, ACL.

[9]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[10]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[11]  Mahmud Fotuhi-Firuzabad,et al.  Reliability-based Selection of Wind Turbines for Large-Scale Wind Farms , 2009 .

[12]  Alexander Vergara,et al.  On the calibration of sensor arrays for pattern recognition using the minimal number of experiments , 2014 .

[13]  Stanislaw Osowski,et al.  Differential electronic nose and support vector machine for fast recognition of tobacco , 2012, Expert Syst. Appl..

[14]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Matthieu Guillaumin,et al.  Incremental Learning of NCM Forests for Large-Scale Image Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Lei Zhang,et al.  Abnormal Odor Detection in Electronic Nose via Self-Expression Inspired Extreme Learning Machine , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Fei-Fei Li,et al.  What Does Classifying More Than 10, 000 Image Categories Tell Us? , 2010, ECCV.

[19]  David Zhang,et al.  Efficient Solutions for Discreteness, Drift, and Disturbance (3D) in Electronic Olfaction , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Amadou Dicko,et al.  Aging fingerprint characterization of beer using electronic nose , 2011 .

[22]  Jian Yang,et al.  Domain class consistency based transfer learning for image classification across domains , 2017, Inf. Sci..

[23]  Tao Liu,et al.  Taste Recognition in E-Tongue Using Local Discriminant Preservation Projection , 2019, IEEE Transactions on Cybernetics.

[24]  Xuelong Li,et al.  A Unified Learning Framework for Single Image Super-Resolution , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Ilja Kuzborskij,et al.  From N to N+1: Multiclass Transfer Incremental Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  David Zhang,et al.  Design of a Breath Analysis System for Diabetes Screening and Blood Glucose Level Prediction , 2014, IEEE Transactions on Biomedical Engineering.

[27]  Ling Shao,et al.  Targeting Accurate Object Extraction From an Image: A Comprehensive Study of Natural Image Matting , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  M. Santonico,et al.  Olfactory systems for medical applications , 2008 .

[29]  Barun Das,et al.  Towards Versatile Electronic Nose Pattern Classifier for Black Tea Quality Evaluation: An Incremental Fuzzy Approach , 2009, IEEE Transactions on Instrumentation and Measurement.

[30]  S. Osowski,et al.  Metal oxide sensor arrays for detection of explosives at sub-parts-per million concentration levels by the differential electronic nose , 2012 .

[31]  Tara N. Sainath,et al.  Deep convolutional neural networks for LVCSR , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[32]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[33]  David Zhang,et al.  Robust Visual Knowledge Transfer via Extreme Learning Machine-Based Domain Adaptation , 2016, IEEE Transactions on Image Processing.

[34]  Jason Weston,et al.  WSABIE: Scaling Up to Large Vocabulary Image Annotation , 2011, IJCAI.

[35]  Alvin Ihsani,et al.  A Kernel Density Estimator-Based Maximum A Posteriori Image Reconstruction Method for Dynamic Emission Tomography Imaging. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[36]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[37]  Qiang Ji,et al.  Constrained Deep Transfer Feature Learning and Its Applications , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Amit K. Roy-Chowdhury,et al.  Incremental Activity Modeling and Recognition in Streaming Videos , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Francisco Herrera,et al.  An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes , 2011, Pattern Recognit..

[40]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[41]  Matthieu Guillaumin,et al.  Incremental Learning of Random Forests for Large-Scale Image Classification , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Yan Liu,et al.  Odor Recognition in Multiple E-Nose Systems With Cross-Domain Discriminative Subspace Learning , 2017, IEEE Transactions on Instrumentation and Measurement.

[43]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[44]  Alvin Ihsani,et al.  A Kernel Density Estimator-Based Maximum A Posteriori Image Reconstruction Method for Dynamic Emission Tomography Imaging , 2016, IEEE Transactions on Image Processing.

[45]  Xiaofeng Zhu,et al.  Efficient kNN Classification With Different Numbers of Nearest Neighbors , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[47]  R. Brereton,et al.  Comparison of performance of five common classifiers represented as boundary methods: Euclidean Distance to Centroids, Linear Discriminant Analysis, Quadratic Discriminant Analysis, Learning Vector Quantization and Support Vector Machines, as dependent on data structure , 2009 .

[48]  Jonathan Tompson,et al.  Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation , 2014, NIPS.

[49]  E. Martinelli,et al.  Lung cancer identification by the analysis of breath by means of an array of non-selective gas sensors. , 2003, Biosensors & bioelectronics.

[50]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[52]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[53]  S. Hasan Saeed,et al.  Modern Applications of Electronic Nose: A Review , 2013 .

[54]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[55]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[56]  Yizhou Yu,et al.  Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  David Zhang,et al.  Domain Adaptation Extreme Learning Machines for Drift Compensation in E-Nose Systems , 2015, IEEE Transactions on Instrumentation and Measurement.

[58]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[59]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.