A novel method for vehicle headlights detection using salient region segmentation and PHOG feature

In this paper, we explore an issue that is to detect vehicle headlights from the nighttime traffic surveillance images with highly reflections. In the night, reflections on the road (water) surface, vehicles bodies, or some reflective objects (such as lane markings, traffic signs) will interfere the headlight detection seriously. Although the existing methods have achieved good results, however, most of them failed to detect the headlight when headlights are far from camera. In order to solve the issue, we propose a novel method for vehicle headlights detection. The proposed method makes full use of the brightness and gradient information of the headlights in the night. First, we propose an effective region-of-interest (ROI) segmentation method which is based on multi-scale local saliency detection. The method pre-serve faint or small-sized objects and retain the original shape of the object to the greatest extent. Then, we compute the pyramid histogram of oriented gradients (PHOG) features, which are used to train support vector machine (SVM) classifier. Finally, the extracted bright blocks are classified according to the pre-trained SVM classifier. Experimental results and quantitative evaluations in different scenes demonstrate that our proposed method can achieve a better result compared with previous methods.

[1]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Yu Yao,et al.  Unsupervised Traffic Accident Detection in First-Person Videos , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[5]  Yang Cao,et al.  Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Chunming Tang,et al.  Multi-Field Depth Vehicle Headlight Detection by Model Construction and Long Trajectory Extraction in Nighttime City Traffic , 2017 .

[7]  Michel Dufaut,et al.  Vehicle detection at night using image processing and pattern recognition , 1994, Proceedings of 1st International Conference on Image Processing.

[8]  Wenguan Wang,et al.  Shifting More Attention to Video Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[10]  Habib Hajimolahoseini,et al.  Robust vehicle tracking algorithm for nighttime videos captured by fixed cameras in highly reflective environments , 2014, IET Comput. Vis..

[11]  Hanseok Ko,et al.  Multiple vehicle tracking based on regional estimation in nighttime CCD images , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[14]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[15]  Hefei Ling,et al.  Salient object detection via spectral graph weighted low rank matrix recovery , 2018, J. Vis. Commun. Image Represent..

[16]  Euntai Kim,et al.  A Novel On-Road Vehicle Detection Method Using $\pi$HOG , 2015, IEEE Transactions on Intelligent Transportation Systems.

[17]  Lei Wu,et al.  Saliency Detection via Topological Feature Modulated Deep Learning , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[18]  Qingquan Li,et al.  Turn Signal Detection During Nighttime by CNN Detector and Perceptual Hashing Tracking , 2017, IEEE Transactions on Intelligent Transportation Systems.

[19]  Bing-Fei Wu,et al.  A Real-Time Vision System for Nighttime Vehicle Detection and Traffic Surveillance , 2011, IEEE Transactions on Industrial Electronics.

[20]  Shifu Zhou,et al.  A Night Time Application for a Real-Time Vehicle Detection Algorithm Based on Computer Vision , 2013 .

[21]  Luis Salgado,et al.  Log-Gabor Filters for Image-Based Vehicle Verification , 2013, IEEE Transactions on Image Processing.

[22]  Kostia Robert Night-Time Traffic Surveillance: A Robust Framework for Multi-vehicle Detection, Classification and Tracking , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[23]  Ming Tang,et al.  Hierarchical and Networked Vehicle Surveillance in ITS: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[24]  Gosuke Ohashi,et al.  Vision-Based Nighttime Vehicle Detection Using CenSurE and SVM , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  Igor V. Kotenko,et al.  Comparative Study of Machine Learning Methods for In-Vehicle Intrusion Detection , 2018, CyberICPS/SECPRE@ESORICS.

[26]  Hong Yan,et al.  Bayes Saliency-Based Object Proposal Generator for Nighttime Traffic Images , 2018, IEEE Transactions on Intelligent Transportation Systems.

[27]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  D. Fernandez,et al.  Night time vehicle detection for driving assistance lightbeam controller , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[29]  Mei Tian,et al.  Robust Nighttime Vehicle Detection by Tracking and Grouping Headlights , 2015, IEEE Transactions on Intelligent Transportation Systems.

[30]  Bernt Schiele,et al.  How good are detection proposals, really? , 2014, BMVC.

[31]  Hong Yan,et al.  Combining Region-of-Interest Extraction and Image Enhancement for Nighttime Vehicle Detection , 2016, IEEE Intelligent Systems.

[32]  Rita Cucchiara,et al.  Vehicle Detection under Day and Night Illumination , 1999, IIA/SOCO.

[33]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[34]  Ho-Youl Jung,et al.  An Effective Method of Head Lamp and Tail Lamp Recognition for Night Time Vehicle Detection , 2010 .

[35]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Kuo-Chin Fan,et al.  Vehicle Detection Using Normalized Color and Edge Map , 2007, IEEE Transactions on Image Processing.

[37]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.

[38]  Wei Zhang,et al.  Tracking and Pairing Vehicle Headlight in Night Scenes , 2012, IEEE Transactions on Intelligent Transportation Systems.

[39]  Ping Li,et al.  Saliency prediction by Mahalanobis distance of topological feature on deep color components , 2019, J. Vis. Commun. Image Represent..

[40]  Ming Xie,et al.  Color modeling by spherical influence field in sensing driving environment , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[41]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[42]  Jiangjiang Liu,et al.  Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground , 2018, ECCV.

[43]  Yun Liu,et al.  DNA: Deeply Supervised Nonlinear Aggregation for Salient Object Detection , 2019, IEEE Transactions on Cybernetics.

[44]  Fei-Yue Wang Scanning the Issue and Beyond: Crowdsourcing for Field Transportation Studies and Services , 2015, IEEE Trans. Intell. Transp. Syst..

[45]  Ali Borji,et al.  Salient object detection: A survey , 2014, Computational Visual Media.