Smoky Vehicle Detection Based on Range Filtering on Three Orthogonal Planes and Motion Orientation Histogram

Smoky vehicle detection is an important task in reducing motor vehicle pollution. This paper presents a method to automatically detect smoky vehicles from the traffic surveillance videos. More specifically, the visual background extractor background subtraction algorithm and some rules are adopted to detect moving vehicle object and locate the key region at the back of the vehicle. Based on sufficient observations of the smoke characteristics in the real scene, three groups of features, including color moments (CMs) features, improved motion orientation histogram features, and the new model range filtering on three orthogonal planes (RF-TOP)-based features, are designed and proposed to distinguish smoky vehicles and non-smoke vehicles. The color information CM features are used as a preliminary sieve to filter out the samples that are obviously non-smoke regions. The other two groups of features are combined to one feature vector to obtain motion information and spatiotemporal information of the key region. Two strategies, including histogram and projection, are designed to extract discriminative dynamic features from the proposed model RF-TOP to characterize the key region. The pruning radial basis function neural network classifier is adopted to classify the extracted features. For the traffic surveillance videos in the daylight with sunny weather, the experimental results show that the proposed methods have better performances and work effectively with lower false alarm rates than existing methods, and the proposed method with histogram strategy achieves the best performance.

[1]  Howard M Kipen,et al.  Acute effects of motor vehicle traffic‐related air pollution exposures on measures of oxidative stress in human airways , 2010, Annals of the New York Academy of Sciences.

[2]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[3]  Jian Wang,et al.  Video smoke detection using shape, color and dynamic features , 2017, J. Intell. Fuzzy Syst..

[4]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[5]  Feiniu Yuan,et al.  A double mapping framework for extraction of shape-invariant features based on multi-scale partitions with AdaBoost for video smoke detection , 2012, Pattern Recognit..

[6]  Tao Chen,et al.  Robust Vehicle Detection and Viewpoint Estimation With Soft Discriminative Mixture Model , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  R. Bracewell Two-dimensional imaging , 1994 .

[8]  Xiaobo Lu,et al.  Smoky vehicle detection based on multi-feature fusion and ensemble neural networks , 2018, Multimedia Tools and Applications.

[9]  Ghazali Sulong,et al.  Vehicle Detection and Tracking Techniques: A Concise Review , 2014, ArXiv.

[10]  ByoungChul Ko,et al.  Spatiotemporal bag-of-features for early wildfire smoke detection , 2013, Image Vis. Comput..

[11]  Liang Zhao,et al.  Fire smoke detection algorithm based on motion characteristic and convolutional neural networks , 2017, Multimedia Tools and Applications.

[12]  Lei Wang,et al.  A Novel Video-Based Smoke Detection Method Using Image Separation , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[13]  S. M. Mahbubur Rahman,et al.  Video-based tracking of vehicles using multiple time-spatial images , 2016, Expert Syst. Appl..

[14]  A. Enis Çetin,et al.  Entropy functional based adaptive decision fusion framework , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[15]  Peter A. Flach,et al.  Precision-Recall-Gain Curves: PR Analysis Done Right , 2015, NIPS.

[16]  I. Szadkowska-stanczyk,et al.  Exposure to diesel exhaust fumes in the context of exposure to ultrafine particles. , 2016, International journal of occupational medicine and environmental health.

[17]  Hanzi Wang,et al.  Sacon: A consensus based model for background subtraction , 2005 .

[18]  A. Enis Çetin,et al.  Wavelet based real-time smoke detection in video , 2005, 2005 13th European Signal Processing Conference.

[19]  Chao-Ho Chen,et al.  An early fire-detection method based on image processing , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[20]  Matti Kutila,et al.  Multi-camera-based smoke detection and traffic pollution analysis system , 2016, 2016 IEEE 12th International Conference on Intelligent Computer Communication and Processing (ICCP).

[21]  Honghai Liu,et al.  Intelligent Video Systems and Analytics: A Survey , 2013, IEEE Transactions on Industrial Informatics.

[22]  Gao Xu,et al.  Smoke detection in video sequences based on dynamic texture using volume local binary patterns , 2017, KSII Trans. Internet Inf. Syst..

[23]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[24]  Yohan Dupuis,et al.  A Survey of Vision-Based Traffic Monitoring of Road Intersections , 2016, IEEE Transactions on Intelligent Transportation Systems.

[25]  Feiniu Yuan,et al.  A fast accumulative motion orientation model based on integral image for video smoke detection , 2008, Pattern Recognit. Lett..

[26]  Lei Wang,et al.  Smoke Detection in Video: An Image Separation Approach , 2013, International Journal of Computer Vision.

[27]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[28]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Xiaobo Lu,et al.  Smoky vehicle detection based on multi-scale block Tamura features , 2018, Signal Image Video Process..

[30]  Honghai Liu,et al.  Ieee Transactions on Industrial Informatics 1 Guest Editorial Special Section on Intelligent Video Systems and Analytics , 2022 .

[31]  Cong Wang,et al.  Relationship Between Persistent Excitation Levels and RBF Network Structures, With Application to Performance Analysis of Deterministic Learning , 2017, IEEE Transactions on Cybernetics.

[32]  Sang Jun Lee,et al.  Learning Framework for Robust Obstacle Detection, Recognition, and Tracking , 2017, IEEE Transactions on Intelligent Transportation Systems.

[33]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[34]  Lei Wang,et al.  Detection and Separation of Smoke From Single Image Frames , 2018, IEEE Transactions on Image Processing.