Multiple target tracking for intelligent headlights control

Intelligent vehicle lighting systems aim at automatically regulate the headlights' beam angle so as to illuminate as much of the road ahead as possible, while avoiding dazzling other drivers. A key component of such a system is a computer vision software able to distinguish blobs due to vehicles' head and rear-lights from those originating from road lamps and reflective elements like poles and traffic signs. In a previous work, we have devised a set of specialized supervised classifiers to make such decisions based on blob features related to its intensity and shape. Despite the overall good performance, there remain challenging cases not yet solved which hamper the adoption of such a system; notably, faint and tiny blobs corresponding to quite distant vehicles which disappear and reappear now and then. One reason for the errors in the classification is that it was carried out independently of other frames. Hence, we address the problem by tracking blobs in order to 1) obtain more feature measurements per blob along its track, 2) compute motion features, which we deem relevant for the classification and 3) enforce its temporal consistency. This paper focuses on the problem of constructing blob tracks, which is actually one of multiple target tracking, but under special conditions: we have to deal with frequent occlusions as well as blob splitings and mergings. We approach it in a novel way, by formulating the problem as a maximum a posteriori inference on a Markov random field. We present qualitative (in video form) and quantitative results which show that our new tracking method achieves good tracking results with regard to the original objective.

[1]  Joan Serrat,et al.  Nighttime Vehicle Detection for Intelligent Headlight Control , 2008, ACIVS.

[2]  Chih-Ming Hsieh,et al.  Vision-based nighttime vehicle detection and range estimation for driver assistance , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[3]  Pushmeet Kohli,et al.  Minimizing sparse higher order energy functions of discrete variables , 2009, CVPR.

[4]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[5]  S. Lakshmanan,et al.  A system for small target detection, tracking, and classification , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[6]  Andreas Busse,et al.  Temporal Coherence Analysis for Intelligent Headlight Control , 2008 .

[7]  Benazouz Bradai,et al.  A monocular vision based advanced lighting automation system for driving assistance , 2009, 2009 IEEE International Symposium on Industrial Electronics.

[8]  Stephanie Hold,et al.  Vehicle recognition and TTC estimation at night based on spotlight pairing , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[9]  Walter Stechele,et al.  Hardware/software architecture of an algorithm for vision-based real-time vehicle detection in dark environments , 2008, 2008 Design, Automation and Test in Europe.

[10]  Pascal Fua,et al.  Real-time vehicle tracking for driving assistance , 2011, Machine Vision and Applications.

[11]  D. Fernandez,et al.  Night time vehicle detection for driving assistance lightbeam controller , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  William T. Freeman,et al.  On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs , 2001, IEEE Trans. Inf. Theory.

[13]  Martin Glavin,et al.  Vehicle Detection at Night Based on Tail-Light Detection , 2010 .

[14]  Sharath Pankanti,et al.  Intelligent headlight control using camera sensors , 2009, UCVP '09.