Multiple vehicle detection and tracking in hard real-time

A vision system is developed that recognizes and tracks multiple cars from sequences of gray-scale images taken from a moving car in hard real-time. The recognition method is based on feature detection, online deformable template matching, and temporal differencing. The vision system utilizes the hard real-time operating system Maruti which guarantees that the timing constraints on the various processes of the vision system are satisfied. The dynamic creation and termination of tracking processes optimizes the amount of computation resources spent and allows fast real-time recognition and tracking of multiple cars as demonstrated over a large number of image frames.

[1]  Karl C. Kluge,et al.  Statistical characterization of the visual characteristics of painted lane markings , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[2]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[3]  Volker Graefe,et al.  Visual recognition of obstacles on roads , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[4]  Thomas Zielke,et al.  An integrated obstacle detection framework for intelligent cruise control on motorways , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[5]  T. Suzuki,et al.  A real-time vision for intelligent vehicles , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[6]  W. J. Gillner,et al.  Motion based vehicle detection on motorways , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[7]  I. Masaki,et al.  A sub-pixel stereo vision system for cost-effective intelligent vehicle applications , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[8]  W. Kruger,et al.  Real-time estimation and tracking of optical flow vectors for obstacle detection , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[9]  Manas Saksena,et al.  Design and Implementation of Maruti-ii 4.1.1 Design Goals , 1994 .

[10]  Charles E. Thorpe,et al.  SCARF: a color vision system that tracks roads and intersections , 1993, IEEE Trans. Robotics Autom..

[11]  Dean A. Pomerleau,et al.  Vision guided lane transition , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[12]  Margrit Betke,et al.  Fast object recognition in noisy images using simulated annealing , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Thierry Pun,et al.  Combining Multiple Motion Estimates for Vehicle Tracking , 1996, ECCV.

[14]  Alberto BroggiDipartimento di Ingegneria dell ' InformazioneUniversit.  Robust real-time lane and road detection in critical shadow conditions , 1995 .

[15]  W. Seelen,et al.  Intensity and edge-based symmetry detection with an application to car-following , 1993 .

[16]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[17]  Mahmood Fathy,et al.  A Window-based Edge Detection Technique for Measuring Road Traffic Parameters in Real-Time , 1995, Real Time Imaging.

[18]  W. von Seelen,et al.  Real-time vehicle tracking and classification , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[19]  Reinhold Behringer,et al.  Simultaneous estimation of pitch angle and lane width from the video image of a marked road , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[20]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Stephen M. Smith,et al.  ASSET-2: real-time motion segmentation and shape tracking , 1995, Proceedings of IEEE International Conference on Computer Vision.

[22]  Alberto Broggi.  Parallel and local feature extraction: a real-time approach to road boundary detection , 1995, IEEE Trans. Image Process..

[23]  R. Behringer.  Detection of discontinuities of road curvature change by GLR , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[24]  Ashok K. Agrawala,et al.  Design and implementation of Maruti-II , 1993 .

[25]  C..  Vision-based Vehicle Guidance , 1992, Springer Series in Perception Engineering.

[26]  Sridhar Lakshmanan,et al.  A deformable-template approach to lane detection , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[27]  Larry S. Davis,et al.  Detection of independently moving objects in passive video , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[28]  H.-H. Nagel,et al.  Model-based recognition of intersections and lane structures , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[29]  Jitendra Malik,et al.  An integrated stereo-based approach to automatic vehicle guidance , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  Henry Schneiderman,et al.  Vision-based robotic convoy driving , 1995 .