Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera

Abstract.Omnidirectional cameras that give a 360° panoramic view of the surroundings have recently been used in many applications such as robotics, navigation, and surveillance. This paper describes the application of parametric ego-motion estimation for vehicle detection to perform surround analysis using an automobile-mounted camera. For this purpose, the parametric planar motion model is integrated with the transformations to compensate distortion in omnidirectional images. The framework is used to detect objects with independent motion or height above the road. Camera calibration as well as the approximate vehicle speed obtained from a CAN bus are integrated with the motion information from spatial and temporal gradients using a Bayesian approach. The approach is tested for various configurations of an automobile-mounted omni camera as well as a rectilinear camera. Successful detection and tracking of moving vehicles and generation of a surround map are demonstrated for application to intelligent driver support.

[1]  Gaudenz Danuser,et al.  Parametric Model Fitting: From Inlier Characterization to Outlier Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Wilfried Enkelmann,et al.  Video-Based Driver Assistance--From Basic Functions to Applications , 2001, International Journal of Computer Vision.

[3]  A. Makadia,et al.  Image processing in catadioptric planes: spatiotemporal derivatives and optical flow computation , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[4]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[5]  Michal Irani,et al.  Computing occluding and transparent motions , 1994, International Journal of Computer Vision.

[6]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[7]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[10]  Ruzena Bajcsy,et al.  Reflective surfaces as computational sensors , 2001, Image Vis. Comput..

[11]  Hans J. Schneebeli,et al.  A general approach for egomotion estimation with omnidirectional images , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[12]  Tarak Gandhi,et al.  Application of planar motion segmentation for scene text extraction , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  P. Anandan,et al.  A unified approach to moving object detection in 2D and 3D scenes , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[14]  Bernd Jähne,et al.  Computer vision and applications: a guide for students and practitioners , 2000 .

[15]  Tarak Gandhi,et al.  Driver's view and vehicle surround estimation using omnidirectional video stream , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[16]  M.M. Trivedi,et al.  Motion based vehicle surround analysis using an omni-directional camera , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[17]  S. Shankar Sastry,et al.  Omnidirectional Egomotion Estimation From Back-projection Flow , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Jon Rigelsford.  Panoramic Vision: Sensors, Theory and Applications , 2002 .

[19]  Jean-Marc Odobez,et al.  Direct incremental model-based image motion segmentation for video analysis , 1998, Signal Process..

[20]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[21]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[22]  Mohan M. Trivedi,et al.  Real-Time Traffic Flow Analysis using Omnidirectional Video Network and Flatplane Transformation , 2002 .

[23]  Tarak Gandhi,et al.  Motion analysis of Omni-Directional video streams for a mobile sentry , 2003, IWVS '03.

[24]  Václav Hlaváč,et al.  MOTION ESTIMATION USING CENTRAL PANORAMIC CAMERAS , 1998 .

[25]  Mohan M. Trivedi,et al.  Video arrays for real-time tracking of person, head, and face in an intelligent room , 2003, Machine Vision and Applications.

[26]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  W. Krüger.  Robust real-time ground plane motion compensation from a moving vehicle , 1999, Machine Vision and Applications.

[28]  S. Lippman,et al.  The Scripps Institution of Oceanography , 1959, Nature.

[29]  M.M. Trivedi,et al.  Vehicle wheel detector using 2D filter banks , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[30]  Manolis I. A. Lourakis,et al.  Visual Detection of Obstacles Assuming a Locally Planar Ground , 1998, ACCV.

[31]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[32]  Eero P. Simoncelli.  Coarse-to-fine estimation of visual motion , 1993 .