Estimating relative vehicle motions in traffic scenes

Abstract Autonomous operation of a vehicle on a road calls for understanding of various events involving the motions of the vehicles in its vicinity. In this paper we show how a moving vehicle which is carrying a camera can estimate the relative motions of nearby vehicles. We show how to “smooth” the motion of the observing vehicle, i.e. to correct the image sequence so that transient motions (primarily rotations) resulting from bumps, etc. are removed and the sequence corresponds more closely to the sequence that would have been collected if the motion had been smooth. We also show how to detect the motions of nearby vehicles relative to the observing vehicle. We present results for several road image sequences which demonstrate the effectiveness of our approach.

[1]  Hans-Hellmut Nagel,et al.  Influence of an Explicitly Modelled 3D Scene on the Tracking of Partially Occluded Vehicles , 1997, Comput. Vis. Image Underst..

[2]  G. Stewart.  Introduction to matrix computations , 1973 .

[3]  Wen-Liang Chen,et al.  Estimations of previewed road curvatures and vehicular motion by a vision-based data fusion scheme , 1997, Machine Vision and Applications.

[4]  Tieniu Tan,et al.  Model-Based Localisation and Recognition of Road Vehicles , 1998, International Journal of Computer Vision.

[5]  Andrea Giachetti,et al.  The use of optical flow for road navigation , 1998, IEEE Trans. Robotics Autom..

[6]  Hans-Hellmut Nagel,et al.  Tracking of complex driving manoeuvres in traffic image sequences , 1998, Image Vis. Comput..

[7]  Tieniu Tan,et al.  Model-independent recovery of object orientations , 1997, IEEE Trans. Robotics Autom..

[8]  Larry S. Davis,et al.  Detection of Independent Motion Using Directional Motion Estimation , 1999, Comput. Vis. Image Underst..

[9]  Azriel Rosenfeld,et al.  Understanding Object Motion of Tools and Vehicles. , 1998, ICCV 1998.

[10]  Azriel Rosenfeld,et al.  Image Sequence Stabilization in Real Time , 1996, Real Time Imaging.

[11]  Leo Dorst.  Analyzing the behaviours of a car: a study in abstraction of goal-directed motions , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Geoffrey D. Sullivan,et al.  Model-based vehicle detection and classification using orthographic approximations , 1997, Image Vis. Comput..

[13]  Soo-Chang Pei,et al.  Vehicle-type motion estimation by the fusion of image point and line features , 1998, Pattern Recognit..

[14]  Hans-Hellmut Nagel,et al.  Algorithmic characterization of vehicle trajectories from image sequences by motion verbs , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Rajeev Sharma,et al.  Early detection of independent motion from active control of normal image flow patterns , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Narendra Ahuja,et al.  3-D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[18]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[19]  Philip H. S. Torr,et al.  Statistical detection of independent movement from a moving camera , 1993, Image Vis. Comput..

[20]  Roldano Cattoni,et al.  Visual routines for real-time monitoring of vehicle behavior , 1998, Machine Vision and Applications.

[21]  Randal C. Nelson.  Qualitative detection of motion by a moving observer , 2004, International Journal of Computer Vision.

[22]  Hans-Hellmut Nagel,et al.  Association of Motion Verbs with Vehicle Movements Extracted from Dense Optical Flow Fields , 1994, ECCV.

[23]  Thierry Pun,et al.  Combining Multiple Motion Estimates for Vehicle Tracking , 1996, ECCV.

[24]  Heinrich Niemann,et al.  Adaptive Road Recognition and Ego-state Tracking in the Presence of Obstacles , 1998, International Journal of Computer Vision.

[25]  Larry S. Davis,et al.  What can projections of flow fields tell us about the visual motion , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Sridhar Lakshmanan,et al.  CLARK: a heterogeneous sensor fusion method for finding lanes and obstacles , 2000, Image Vis. Comput..

[27]  Dean A. Pomerleau,et al.  Detecting Overtaking Vehicles With Implicit Optical Flow , 1997 .

[28]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[29]  Andrew Zisserman,et al.  Detection and tracking of independent motion , 1996, Image Vis. Comput..

[30]  Rama Chellappa,et al.  Time-to-X: analysis of motion through temporal parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Azriel Rosenfeld,et al.  Understanding object motion , 1998, Image Vis. Comput..

[32]  Alessandro Verri,et al.  Against Quantitative Optical Flow , 1987 .

[33]  M. G. Bekker.  Introduction to Terrain-Vehicle Systems , 1969 .

[34]  Michal Irani,et al.  Recovery of ego-motion using image stabilization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Uwe Franke,et al.  Road recognition in urban environment , 2000, Image Vis. Comput..

[36]  Larry S. Davis,et al.  Multiple vehicle detection and tracking in hard real-time , 1996, Proceedings of Conference on Intelligent Vehicles.

[37]  Rama Chellappa,et al.  Selective stabilization of images acquired by unmanned ground vehicles , 1997, IEEE Trans. Robotics Autom..

[38]  R. Chellappa,et al.  Fast 3D stabilization and mosaic construction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Christoph Stiller,et al.  Multisensor obstacle detection and tracking , 2000, Image Vis. Comput..

[40]  W. Krüger.  Robust real-time ground plane motion compensation from a moving vehicle , 1999, Machine Vision and Applications.

[41]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Michal Irani,et al.  Detecting and Tracking Multiple Moving Objects Using Temporal Integration , 1992, ECCV.

[43]  Hans-Hellmut Nagel,et al.  3D Pose Estimation by Directly Matching Polyhedral Models to Gray Value Gradients , 1997, International Journal of Computer Vision.