A closer look on traffic light detection evaluation metrics

Recognition of traffic lights is of crucial interest for intelligent vehicles. For camera based detection systems traffic lights constitute important objects that have some specialties in contrast to other traffic related objects: For a better sight of road users on traffic lights in many cases they are placed redundantly. Furthermore, at bigger intersections a particular traffic light often only denotes information for a particular lane. For a road user or intelligent vehicle only a relevant traffic light showing the information for the desired turning direction has to be found. When evaluating traffic light recognition systems for different use cases a different level of information needs to be evaluated as well. This paper provides a closer look on evaluation metrics and uses a real world dataset for providing examples of different metrics.

[1]  Mohan M. Trivedi,et al.  Ongoing work on traffic lights: Detection and evaluation , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[2]  Mohan M. Trivedi,et al.  Vision for Looking at Traffic Lights: Issues, Survey, and Perspectives , 2016, IEEE Transactions on Intelligent Transportation Systems.

[3]  Johann Marius Zöllner,et al.  Visual state estimation of traffic lights using hidden Markov models , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[4]  Shinichiro Omachi,et al.  Detection of traffic light using structural information , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[5]  Chris Urmson,et al.  Traffic light mapping and detection , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Fawzi Nashashibi,et al.  Real time visual traffic lights recognition based on Spot Light Detection and adaptive traffic lights templates , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[7]  Javier J. Sánchez Medina,et al.  Suspended traffic lights detection and distance estimation using color features , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[8]  F. Lindner,et al.  Robust recognition of traffic signals , 2004, IEEE Intelligent Vehicles Symposium, 2004.