Non-Linear Dimensionality Reduction and Gaussian Process Based Classification Method for Smoke Detection

To improve smoke detection accuracy, we combine local binary pattern (LBP) like features, kernel principal component analysis (KPCA), and Gaussian process regression (GPR) to propose a novel data processing pipeline for smoke detection. The data processing pipeline consists of three steps including original feature extraction, dimensionality reduction, and classification. We use LBP-like methods to extract original features. To obtain a more discriminant feature, KPCA is used to non-linearly map the original features into a discriminant feature space, where manifold structures are embedded. Finally, in order to improve generalization performance, we apply GPR to model classification as a Gaussian process by imposing Gaussian priors on both data and hyper-parameters. In addition, we can replace any steps of the pipeline by similar methods for further improvement or exploration, so the pipeline is flexible and extensible. Experimental results show that KPCA and GPR are truly able to improve the performance of smoke detection and texture classification, and our method obviously outperforms the same features with Support Vector Machine (SVM).

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[3]  Ling Shao,et al.  Realistic action recognition via sparsely-constructed Gaussian processes , 2014, Pattern Recognit..

[4]  Tao Mei,et al.  High-order local ternary patterns with locality preserving projection for smoke detection and image classification , 2016, Inf. Sci..

[5]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[6]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[7]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Fei Zhou,et al.  Single-Image Super-Resolution Based on Compact KPCA Coding and Kernel Regression , 2015, IEEE Signal Processing Letters.

[9]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[11]  Feiniu Yuan,et al.  Rotation and scale invariant local binary pattern based on high order directional derivatives for texture classification , 2014, Digit. Signal Process..

[12]  Donghoon Lee,et al.  Face alignment using cascade Gaussian process regression trees , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Hong Zhang,et al.  Real-time detection of steam in video images , 2007, Pattern Recognit..

[14]  Tomoko Matsui,et al.  Music Genre and Emotion Recognition Using Gaussian Processes , 2014, IEEE Access.

[15]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[16]  Feiniu Yuan,et al.  A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection , 2012, Pattern Recognit..

[17]  Rui Wang,et al.  Sub Oriented Histograms of Local Binary Patterns for Smoke Detection and Texture Classification , 2016, KSII Trans. Internet Inf. Syst..

[18]  Edward Challis,et al.  Gaussian process classification of Alzheimer's disease and mild cognitive impairment from resting-state fMRI , 2015, NeuroImage.

[19]  Shiqian Wu,et al.  Real-time image smoke detection using staircase searching-based dual threshold AdaBoost and dynamic analysis , 2015, IET Image Process..

[20]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[21]  Roland Göcke,et al.  Group expression intensity estimation in videos via Gaussian Processes , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[22]  Yun Q. Shi,et al.  Revealing the Traces of Median Filtering Using High-Order Local Ternary Patterns , 2014, IEEE Signal Processing Letters.

[23]  Trevor Darrell,et al.  Discriminative Gaussian process latent variable model for classification , 2007, ICML '07.

[24]  Xueming Qian,et al.  PLBP: An effective local binary patterns texture descriptor with pyramid representation , 2011, Pattern Recognit..

[25]  Feiniu Yuan,et al.  A fast accumulative motion orientation model based on integral image for video smoke detection , 2008, Pattern Recognit. Lett..

[26]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[27]  Jiawei Han,et al.  Speed up kernel discriminant analysis , 2011, The VLDB Journal.

[28]  Xiaoou Tang,et al.  Surpassing Human-Level Face Verification Performance on LFW with GaussianFace , 2014, AAAI.

[29]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[30]  Cheng Wang,et al.  A KPCA texture feature model for efficient segmentation of RADARSAT-2 SAR sea ice imagery , 2014 .

[31]  Gang Hua,et al.  Multi-class Multi-annotator Active Learning with Robust Gaussian Process for Visual Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Marimuthu Palaniswami,et al.  Smoke detection in video using wavelets and support vector machines , 2009 .

[33]  Zhifeng Li,et al.  Orthogonal Gaussian Process for Automatic Age Estimation , 2014, ACM Multimedia.

[34]  Pengfei Shi,et al.  Face recognition using difference vector plus KPCA , 2012, Digit. Signal Process..

[35]  Vijay Kumar,et al.  Robust Control of Mobility and Communications in Autonomous Robot Teams , 2013, IEEE Access.

[36]  Mohammed Bennamoun,et al.  An efficient 3D face recognition approach using local geometrical signatures , 2014, Pattern Recognit..

[37]  Wen-Hsien Fang,et al.  Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Heiko Hoffmann,et al.  Kernel PCA for novelty detection , 2007, Pattern Recognit..

[39]  Erik G. Larsson,et al.  Kernel Methods for Accurate UWB-Based Ranging With Reduced Complexity , 2015, IEEE Transactions on Wireless Communications.