Robust and Computationally Lightweight Autonomous Tracking of Vehicle Taillights and Signal Detection by Embedded Smart Cameras

An important aspect of collision avoidance and driver assistance systems, as well as autonomous vehicles, is the tracking of vehicle taillights and the detection of alert signals (turns and brakes). In this paper, we present the design and implementation of a robust and computationally lightweight algorithm for a real-time vision system, capable of detecting and tracking vehicle taillights, recognizing common alert signals using a vehicle-mounted embedded smart camera, and counting the cars passing on both sides of the vehicle. The system is low-power and processes scenes entirely on the microprocessor of an embedded smart camera. In contrast to most existing work that addresses either daytime or nighttime detection, the presented system provides the ability to track vehicle taillights and detect alert signals regardless of lighting conditions. The mobile vision system has been tested in actual traffic scenes and the results obtained demonstrate the performance and the lightweight nature of the algorithm.

[1]  Sei-Wang Chen,et al.  A real-time visual-based front-mounted vehicle collision warning system , 2013, 2013 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS).

[2]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[3]  I. Cabani,et al.  Color-based detection of vehicle lights , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Poj Tangamchit,et al.  Predictive brake warning at night using taillight characteristic , 2009, 2009 IEEE International Symposium on Industrial Electronics.

[5]  Jun-Wei Hsieh,et al.  Nighttime Turn Signal Detection by Scatter Modeling and Reflectance-Based Direction Recognition , 2014, IEEE Sensors Journal.

[6]  Toby P. Breckon,et al.  Real-time video analysis for vehicle lights detection using temporal information , 2007, IET 4th European Conference on Visual Media Production (CVMP 2007).

[7]  Duan-Yu Chen,et al.  Frequency-Tuned Nighttime Brake-Light Detection , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[8]  Ho Gi Jung,et al.  Enhancing Light Blob Detection for Intelligent Headlight Control Using Lane Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[9]  Kai She,et al.  Vehicle tracking using on-line fusion of color and shape features , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[10]  Hsu-Yung Cheng,et al.  Vehicle tracking in daytime and nighttime traffic surveillance videos , 2010, 2010 2nd International Conference on Education Technology and Computer.

[11]  H. Sorenson.  Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[12]  R. Ogura,et al.  Vehicles detection based on extremas in nighttime driving scene , 2012, The 1st IEEE Global Conference on Consumer Electronics 2012.

[13]  Chieh-Chih Wang,et al.  LADAR-based detection and tracking of moving objects from a ground vehicle at high speeds , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[14]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[15]  Ming-Yang Chern,et al.  The lane recognition and vehicle detection at night for a camera-assisted car on highway , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[16]  Hsu-Yung Cheng,et al.  Intelligent Highway Traffic Surveillance With Self-Diagnosis Abilities , 2011, IEEE Transactions on Intelligent Transportation Systems.

[17]  Bing-Fei Wu,et al.  A Real-Time Vision System for Nighttime Vehicle Detection and Traffic Surveillance , 2011, IEEE Transactions on Industrial Electronics.

[18]  Kang-Hyun Jo,et al.  Vehicle detection using tail light segmentation , 2011, Proceedings of 2011 6th International Forum on Strategic Technology.

[19]  Allen Y. Yang,et al.  CITRIC: A low-bandwidth wireless camera network platform , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[20]  Yen-Lin Chen,et al.  Embedded on-road nighttime vehicle detection and tracking system for driver assistance , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[21]  Walter Stechele,et al.  Hardware/software architecture of an algorithm for vision-based real-time vehicle detection in dark environments , 2008, 2008 Design, Automation and Test in Europe.

[22]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Xing Li,et al.  Vision-Based Method for Forward Vehicle Detection and Tracking , 2013, 2013 International Conference on Mechanical and Automation Engineering.

[24]  Kostia Robert.  Night-Time Traffic Surveillance: A Robust Framework for Multi-vehicle Detection, Classification and Tracking , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[25]  Jean-Philippe Martin-Flatin,et al.  Self-Managed Networks, Systems, and Services , 2006, Lecture Notes in Computer Science.

[26]  Tae Yong Kim,et al.  A novel signal processing technique for vehicle detection radar , 2003, IEEE MTT-S International Microwave Symposium Digest, 2003.

[27]  Rahul Sukthankar,et al.  RACCOON: A Real-time Autonomous Car Chaser Operating Optimally At Night , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[28]  Noriyoshi Okamoto,et al.  Extraction of forward vehicles by front-mounted camera using brightness information , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[29]  Senem Velipasalar,et al.  Autonomous tracking of vehicle rear lights and detection of brakes and turn signals , 2012, 2012 IEEE Symposium on Computational Intelligence for Security and Defence Applications.

[30]  Joan Serrat,et al.  Multiple target tracking for intelligent headlights control , 2010, ITSC.

[31]  Edward Jones,et al.  Rear-Lamp Vehicle Detection and Tracking in Low-Exposure Color Video for Night Conditions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[32]  Jiann-Der Lee,et al.  Close range vehicle detection and tracking by vehicle lights , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[33]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[34]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[35]  Bing-Fei Wu,et al.  Real-time vision-based multiple vehicle detection and tracking for nighttime traffic surveillance , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[36]  Li-Chen Fu,et al.  Vehicle Detection under Various Lighting Conditions by Incorporating Particle Filter , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[37]  Raúl Rojas,et al.  Kalman filter for vision tracking , 2005 .

[38]  Senem Velipasalar,et al.  A Robust Algorithm for the Detection of Vehicle Turn Signals and Brake Lights , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.