Towards an Automatic Blind Spot Camera: Robust Real-time Pedestrian Tracking from a Moving Camera

In this paper, we present a real-time pedestrian tracker that combines a robust appearance-based pedestrian detector with application-specific constraints and motion information. The targeted application is the automatic detection of vulnerable road users in blind spot cameras on trucks. This application imposes several challenges that need to be tackled. Vulnerable road users are a very diverse class, and we need a high precision and recall rate with real-time performance. Here, we present a first step towards such an automatic detection system. The novelty of our approach is the extension of a robust pedestrian detector towards real-time performance. The information from the appearance-based detector is used in combination with motion-based estimations to efficiently reduce the search space for the appearance-based detector in consecutive frames. This results in a multi-pedestrian tracker from a moving camera which is both optimized in terms of accuracy and speed. We recorded several data sequences to evaluate our pedestrian tracker, and performed initial experiments with promising results.

[1]  Riad I. Hammoud,et al.  Robust Multi-Pedestrian Tracking in Thermal-Visible Surveillance Videos , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[2]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Larry S. Davis,et al.  Pedestrian tracking from a moving vehicle , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[4]  Christoph H. Lampert,et al.  Efficient Subwindow Search: A Branch and Bound Framework for Object Localization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[9]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[11]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[12]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.

[14]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[15]  Allan Hanbury,et al.  Fast pedestrian tracking based on spatial features and colour , 2006 .