Smoky vehicle detection based on multi-feature fusion and ensemble neural networks

Existing methods of smoky vehicle detection from the traffic flow are inefficiency and need a large number of workers. To solve this issue, we propose an automatic smoky vehicle detection method based on multi-feature fusion and ensemble back-propagation neural networks (E-BPNN). In this method, the Vibe background subtraction algorithm and some rules are adopted to detect vehicle objects. To obtain the key region at the back of the vehicle where may be the most possible to have black smoke, the integral projection is utilized to detect the position of the vehicle rear. The proposed LHI features, which fuse Local Binary Pattern (LBP), Histograms of Oriented Gradients (HOG) and Integral Projection (IP), are extracted from the key region. The E-BPNN are adopted to distinguish smoky vehicles and non-smoke vehicles by making classification of the extracted LHI features. The proposed algorithm framework can automatically detect smoky vehicles through analyzing road surveillance videos which obtained in the daytime with good weather conditions. The experimental results show that the proposed method of the E-BPNN with multi-feature fusion has a better performance than the method of the BPNN with single features. In addition, the proposed method also has low false alarm rates than common smoke and fire detection methods.

[1]  A. Enis Çetin,et al.  Entropy-Functional-Based Online Adaptive Decision Fusion Framework With Application to Wildfire Detection in Video , 2012, IEEE Transactions on Image Processing.

[2]  Surender Dhanaekaran,et al.  A Survey on Vehicle Detection based on Vision , 2015 .

[3]  Peter A. Flach,et al.  Precision-Recall-Gain Curves: PR Analysis Done Right , 2015, NIPS.

[4]  Nilanjan Dey,et al.  Haralick Features Based Automated Glaucoma Classification Using Back Propagation Neural Network , 2014, FICTA.

[5]  Alessandro Santana Martins,et al.  LBP operators on curvelet coefficients as an algorithm to describe texture in breast cancer tissues , 2016, Expert Syst. Appl..

[6]  J. Kaplan,et al.  Uncertainties in isoprene photochemistry and emissions: implications for the oxidative capacity of past and present atmospheres and for climate forcing agents , 2015 .

[7]  Vincenzo Piuri,et al.  Wildfire Smoke Detection Using Computational Intelligence Techniques Enhanced With Synthetic Smoke Plume Generation , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  ByoungChul Ko,et al.  Spatiotemporal bag-of-features for early wildfire smoke detection , 2013, Image Vis. Comput..

[9]  Hanyang Man,et al.  Characterization of road freight transportation and its impact on the national emission inventory in China , 2014 .

[10]  Valen E. Johnson,et al.  Image Restoration and Reconstruction , 2006 .

[11]  Wanqing Li,et al.  Smoke detection in videos using Non-Redundant Local Binary Pattern-based features , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[12]  Allen L Robinson,et al.  Rethinking Organic Aerosols: Semivolatile Emissions and Photochemical Aging , 2007, Science.

[13]  P. DeCarlo,et al.  Impact of aftertreatment devices on primary emissions and secondary organic aerosol formation potential from in-use diesel vehicles: results from smog chamber experiments , 2010 .

[14]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  ByoungChul Ko,et al.  Wildfire smoke detection using spatiotemporal bag-of-features of smoke , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[16]  Feiniu Yuan,et al.  A Deep Normalization and Convolutional Neural Network for Image Smoke Detection , 2017, IEEE Access.

[17]  Matti Kutila,et al.  Multi-camera-based smoke detection and traffic pollution analysis system , 2016, 2016 IEEE 12th International Conference on Intelligent Computer Communication and Processing (ICCP).

[18]  A. Enis Çetin,et al.  Wavelet based real-time smoke detection in video , 2005, 2005 13th European Signal Processing Conference.

[19]  Inkyu Park,et al.  Blur‐Invariant Feature Descriptor Using Multidirectional Integral Projection , 2016 .

[20]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[22]  Jian Wang,et al.  Video smoke detection using shape, color and dynamic features , 2017, J. Intell. Fuzzy Syst..

[23]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[24]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Andreas Uhl,et al.  A scale- and orientation-adaptive extension of Local Binary Patterns for texture classification , 2015, Pattern Recognit..

[26]  Fei Long,et al.  Video-Based Fire Detection with Saliency Detection and Convolutional Neural Networks , 2017, ISNN.

[27]  R.H.T. Bates,et al.  Image Restoration and Construction , 1986 .

[28]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[29]  Chang-hong Chen,et al.  VOC species and emission inventory from vehicles and their SOA formation potentials estimation in Shanghai, China , 2015 .

[30]  Simone Calderara,et al.  Vision based smoke detection system using image energy and color information , 2011, Machine Vision and Applications.

[31]  Margarita N. Favorskaya,et al.  Verification of Smoke Detection in Video Sequences Based on Spatio-temporal Local Binary Patterns , 2015, KES.

[32]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[33]  Xiaobo Lu,et al.  Smoky vehicle detection based on multi-scale block Tamura features , 2018, Signal Image Video Process..

[34]  Jiming Hao,et al.  On-road vehicle emissions and their control in China: A review and outlook. , 2017, The Science of the total environment.

[35]  Wei Liu,et al.  Effective background modelling and subtraction approach for moving object detection , 2015, IET Comput. Vis..

[36]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Darko Stipanicev,et al.  Visual spatial-context based wildfire smoke sensor , 2012, Machine Vision and Applications.

[38]  Mihai E. Popa,et al.  Vehicle emissions of greenhouse gases and related tracers from a tunnel study: CO:CO2, N2O:CO2, CH4: , 2013 .

[39]  Kun Liu,et al.  Rotation-Invariant HOG Descriptors Using Fourier Analysis in Polar and Spherical Coordinates , 2014, International Journal of Computer Vision.

[40]  Liang Zhao,et al.  Fire smoke detection algorithm based on motion characteristic and convolutional neural networks , 2017, Multimedia Tools and Applications.

[41]  Jakub Konecný,et al.  One-shot-learning gesture recognition using HOG-HOF features , 2014, J. Mach. Learn. Res..