Motion based vehicle surround analysis using an omni-directional camera

Omni-directional cameras which give 360 degree panoramic view of the surroundings and have recently been used in many applications such as robotics, navigation and surveillance. This paper describes the application of motion estimation on omni camera to perform surround analysis using an automobile mounted camera. The system detects and tracks the surrounding vehicles by compensating the ego-motion and detecting objects having independent motion. Prior knowledge about ego-motion and calibration is optimally combined with the information from the image gradients to get better motion compensation.

[1]  W. Krüger.  Robust real-time ground plane motion compensation from a moving vehicle , 1999, Machine Vision and Applications.

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Tarak Gandhi,et al.  Motion analysis of Omni-Directional video streams for a mobile sentry , 2003, IWVS '03.

[4]  Bernd Jähne,et al.  Computer vision and applications: a guide for students and practitioners , 2000 .

[5]  Tarak Gandhi,et al.  Driver's view and vehicle surround estimation using omnidirectional video stream , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[6]  S. Shankar Sastry,et al.  Omnidirectional Egomotion Estimation From Back-projection Flow , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  Eero P. Simoncelli.  Coarse-to-fine estimation of visual motion , 1993 .

[8]  Takeo Kanade,et al.  Transforming camera geometry to a virtual downward-looking camera: robust ego-motion estimation and ground-layer detection , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Jan-Olof Eklundh,et al.  Object detection using model based prediction and motion parallax , 1990, ECCV.

[10]  Mohan M. Trivedi,et al.  Video arrays for real-time tracking of person, head, and face in an intelligent room , 2003, Machine Vision and Applications.

[11]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[12]  Jon Rigelsford.  Panoramic Vision: Sensors, Theory and Applications , 2002 .

[13]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  P. Anandan,et al.  A unified approach to moving object detection in 2D and 3D scenes , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[15]  Wilfried Enkelmann,et al.  Video-Based Driver Assistance--From Basic Functions to Applications , 2001, International Journal of Computer Vision.

[16]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[17]  Mohan M. Trivedi,et al.  Real-Time Traffic Flow Analysis using Omnidirectional Video Network and Flatplane Transformation , 2002 .