Learning to tell brake lights with convolutional features

In this paper, we present a learning-based brake light classification algorithm for intelligent driver-assistance systems. State-of-the-art approaches apply different image processing techniques with hand-crafted features to determine whether brake lights are on or off. In contrast, we learn a brake light classifier based on discriminative color descriptors and convolutional features fine-tuned for traffic scenes. We show how brake light regions can be segmented and classified in one framework. Numerous experimental results show that the proposed algorithm performs well against state-of-the-art alternatives in real-world scenes.

[1]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Neil A. Dodgson,et al.  Proceedings Ninth IEEE International Conference on Computer Vision , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Edward Jones,et al.  Rear-Lamp Vehicle Detection and Tracking in Low-Exposure Color Video for Night Conditions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[7]  Senem Velipasalar,et al.  Autonomous tracking of vehicle rear lights and detection of brakes and turn signals , 2012, 2012 IEEE Symposium on Computational Intelligence for Security and Defence Applications.

[8]  Cordelia Schmid,et al.  Learning Color Names from Real-World Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Frank Merat,et al.  Brake Light Detection by Image Segmentation , 2006 .

[10]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[12]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[13]  Ming-Hsuan Yang,et al.  An Ensemble Color Model for Human Re-identification , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  Luc Van Gool,et al.  Moment invariants for recognition under changing viewpoint and illumination , 2004, Comput. Vis. Image Underst..

[16]  Hsin-Mu Tsai,et al.  A Vision-Based Hierarchical Framework for Autonomous Front-Vehicle Taillights Detection and Signal Recognition , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[17]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Simant Prakoonwit,et al.  An Algorithm for Accurate Taillight Detection at Night , 2014 .

[19]  Cheng Xu,et al.  Vision-Based Method for Forward Vehicle Brake Lights Recognition , 2015 .

[20]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[22]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Senem Velipasalar,et al.  A Robust Algorithm for the Detection of Vehicle Turn Signals and Brake Lights , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[25]  Martin Glavin,et al.  Vehicle Detection at Night Based on Tail-Light Detection , 2010 .