Real-time moving object detection using a vehicle-mounted monocular rear-view fisheye camera

In this paper, we propose a moving object detection algorithm that enables to detect moving objects with collision risk in rear of the vehicle by using image sequences from a vehicle-mounted monocular rear-view fisheye camera. The proposed moving object detection algorithm detects corner points by using Harris corner detector and computes the optical flow vectors from two consecutive images corresponds to the detected corner points. By considering the feature of the vehicle movement that the vehicle goes straight in a short time interval, we find the focus of expansion (FOE) by using matched filter and divide the image into four sections around the FOE. The optical flow angle distribution of each section is analyzed to find pixels corresponds to the background components and robust background motion compensation method to the complex scene is suggested. Add to this, we propose false removal method that eliminates false positives by considering two features of the detection box for the moving object candidates; position and pixel intensity distribution. Simulation results show that our proposed algorithm achieves 97.19% of detection rate toward various detection target including pedestrians, bicycles, and cars. Furthermore, our proposed false removal algorithm performs an extremely low 2.7% of false rate toward false positives such as trees, shadows, and road markers.

[1]  Markus Hess,et al.  Object Detection and Classification Using a Rear In-Vehicle Fisheye Camera , 2013 .

[2]  Chong Sun,et al.  A real-time rear view camera based obstacle detection , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[3]  W. Kruger,et al.  Obstacle detection by real-time optical flow evaluation , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[4]  Takeo Kato,et al.  Vehicle Ego-Motion Estimation and Moving Object Detection using a Monocular Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  Dong-Sun Kim,et al.  Moving Object Detection on a Vehicle Mounted Back-Up Camera , 2015, Sensors.

[6]  Ehud Rivlin,et al.  Finding the focus of expansion and estimating range using optical flow images and a matched filter , 2004, Machine Vision and Applications.

[7]  Xue Chen,et al.  A vehicle detection approach based on multi-features fusion in the fisheye images , 2011, 2011 3rd International Conference on Computer Research and Development.

[8]  Amnon Shashua,et al.  A robust method for computing vehicle ego-motion , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[9]  Norman Weyrich,et al.  A single camera based rear obstacle detection system , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[10]  Holger G. Krapp,et al.  Extracting Egomotion from Optic Flow: Limits of Accuracy and Neural Matched Filters , 2001 .

[11]  C. Laugier,et al.  Real-time moving obstacle detection using optical flow models , 2006, 2006 IEEE Intelligent Vehicles Symposium.