A Blind-Zone Detection Method Using a Rear-Mounted Fisheye Camera With Combination of Vehicle Detection Methods

This paper proposes a novel approach for detecting and tracking vehicles to the rear and in the blind zone of a vehicle, using a single rear-mounted fisheye camera and multiple detection algorithms. A maneuver that is a significant cause of accidents involves a target vehicle approaching the host vehicle from the rear and overtaking into the adjacent lane. As the overtaking vehicle moves toward the edge of the image and into the blind zone, the view of the vehicle gradually changes from a front view to a side view. Furthermore, the effects of fisheye distortion are at their most pronounced toward the extremities of the image, rendering detection of a target vehicle entering the blind zone even more difficult. The proposed system employs an AdaBoost classifier at distances of 10-40 m between the host and target vehicles. For detection at short distances where the view of a target vehicle has changed to a side view and the AdaBoost classifier is less effective, identification of vehicle wheels is proposed. Two methods of wheel detection are employed: at distances between 5 and 15 m, a novel algorithm entitled wheel arch contour detection (WACD) is presented, and for distances less than 5 m, Hough circle detection provides reliable wheel detection. A testing framework is also presented, which categorizes detection performance as a function of distance between host and target vehicles. Experimental results indicate that the proposed method results in a detection rate of greater than 93% in the critical range (blind zone) of the host.

[1]  Ying Zhu,et al.  Reliable Detection of Overtaking Vehicles Using Robust Information Fusion , 2006, IEEE Transactions on Intelligent Transportation Systems.

[2]  Chih-Hsien Hsia,et al.  Panoramic image stitching system for automotive applications , 2014, 2014 IEEE International Conference on Consumer Electronics - Taiwan.

[3]  Xue Chen,et al.  A vehicle detection approach based on multi-features fusion in the fisheye images , 2011, 2011 3rd International Conference on Computer Research and Development.

[4]  José Luis Gordillo,et al.  A new method to follow a path on indoor environments applied for mobile robotics , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[5]  Christopher Nemeth,et al.  Sequential Monte Carlo Methods for State and Parameter Estimation in Abruptly Changing Environments , 2014, IEEE Transactions on Signal Processing.

[6]  Mohan M. Trivedi,et al.  Vehicle Detection by Independent Parts for Urban Driver Assistance , 2013, IEEE Transactions on Intelligent Transportation Systems.

[7]  Kenji Nishida,et al.  Real-Time Vehicle Detection using a Single Rear Camera for a Blind Spot Warning System , 2012 .

[8]  C. Fernández,et al.  Real-time vision-based blind spot warning system: Experiments with motorcycles in daytime/nighttime conditions , 2013 .

[9]  Helen Sutherland,et al.  The Royal Society for the Prevention of Accidents , 1950 .

[10]  Rong-Chin Lo,et al.  An improved obstacle detection using optical flow adjusting based on inverse perspective mapping for the vehicle safety , 2012, 2012 International Symposium on Intelligent Signal Processing and Communications Systems.

[11]  Andrew Zisserman,et al.  Planar grouping for automatic detection of vanishing lines and points , 2000, Image Vis. Comput..

[12]  A. Makadia,et al.  Image processing in catadioptric planes: spatiotemporal derivatives and optical flow computation , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[13]  Yasuhisa Hayakawa,et al.  All Round Blind Spot Detection by Lens Condition Adaptation based on Rearview Camera Images , 2013 .

[14]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[15]  Din-Chang Tseng,et al.  Blind-Spot Vehicle Detection Using Motion and Static Features , 2014 .

[16]  Edward Jones,et al.  Wide-angle camera technology for automotive applications: a review , 2009 .

[17]  Cheng-Yen Yang,et al.  An Embedded All-Time Blind Spot Warning System , 2010 .

[18]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[19]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[20]  David Fernández Llorca,et al.  Parking Assistance System for Leaving Perpendicular Parking Lots: Experiments in Daytime\/Nighttime Conditions , 2014, IEEE Intelligent Transportation Systems Magazine.

[21]  Bing-Fei Wu,et al.  A vision-based blind spot warning system for daytime and nighttime driver assistance , 2013, Comput. Electr. Eng..

[22]  Elena Cardarelli Vision-based Blind Spot Monitoring , 2011 .

[23]  Huei-Yung Lin,et al.  Lane departure and front collision warning using a single camera , 2012, 2012 International Symposium on Intelligent Signal Processing and Communications Systems.

[24]  V. K. Pandey,et al.  Real-time Object Detection by Road Plane Segmentation Technique for ADAS , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[25]  Dot Hs,et al.  Analysis of Lane-Change Crashes and Near-Crashes , 2009 .

[26]  Fuqiang Liu,et al.  Vehicle localisation using a single camera , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[27]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Angelos Amditis,et al.  Lateral motion tracking of automobiles , 2004 .

[29]  Mohan M. Trivedi,et al.  A General Active-Learning Framework for On-Road Vehicle Recognition and Tracking , 2010, IEEE Transactions on Intelligent Transportation Systems.

[30]  Uwe Franke,et al.  Visual guard rail detection for advanced highway assistance systems , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[31]  Hongbin Zha,et al.  On-road vehicle detection through part model learning and probabilistic inference , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Wolfram Burgard,et al.  Improved Monte Carlo localization of autonomous robots through simultaneous estimation of motion model parameters , 2010, 2010 IEEE International Conference on Robotics and Automation.

[33]  Yu Liu,et al.  Fish-eye distortion correction based on midpoint circle algorithm , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[34]  Sanjeev Singh,et al.  SideEye: Mobile assistant for blind spot monitoring , 2014, 2014 International Conference on Computing, Networking and Communications (ICNC).

[35]  Ying Wang,et al.  On-road multi-vehicle tracking algorithm based on an improved particle filter , 2015 .

[36]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  L. Udawatta,et al.  Identification of moving obstacles with Pyramidal Lucas Kanade optical flow and k means clustering , 2007, 2007 Third International Conference on Information and Automation for Sustainability.

[38]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[39]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[40]  Bo Wang,et al.  Robust traffic sign recognition and tracking for Advanced Driver Assistance Systems , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[41]  Geoff Wyvill,et al.  The integral image method for fisheye images , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[42]  Li-Chen Fu,et al.  Integrating Appearance and Edge Features for Sedan Vehicle Detection in the Blind-Spot Area , 2012, IEEE Transactions on Intelligent Transportation Systems.

[43]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[44]  J. Antin,et al.  Evaluation of Lane Change Collision Avoidance Systems Using the National Advanced Driving Simulator , 2010 .

[45]  Chang Wen Chen,et al.  A novel video analysis approach for overtaking vehicle detection , 2013, 2013 International Conference on Connected Vehicles and Expo (ICCVE).

[46]  Mohan M. Trivedi,et al.  Overtaking & receding vehicle detection for driver assistance and naturalistic driving studies , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[47]  Bruno Steux,et al.  YEF (Yet Even Faster) Real-Time Object Detection , 2005, ALaRT.

[48]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[49]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[50]  Vincent Frémont,et al.  Multi-sensors people detection system for heavy machines , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[51]  Liam Kilmartin,et al.  A comprehensive test framework to determine the spatial performance of camera-based vehicle detection algorithms , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[52]  Alberto Broggi,et al.  Vehicle detection for autonomous parking using a Soft-Cascade AdaBoost classifier , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[53]  Fabien Moutarde,et al.  Real-time visual detection of vehicles and pedestrians with new efficient adaBoost features , 2008 .

[54]  Javier Díaz,et al.  Low-cost sensor to detect overtaking based on optical flow , 2011, Machine Vision and Applications.

[55]  Edward Jones,et al.  Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Mohan M. Trivedi,et al.  Integrating motion and appearance for overtaking vehicle detection , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[58]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[59]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[60]  庞彦伟,et al.  Fisheye image vehicle identification method , 2011 .

[61]  Bruno Steux,et al.  Yet Even Faster (YEF) real-time object detection , 2007, Int. J. Intell. Syst. Technol. Appl..

[62]  Alberto Broggi,et al.  Vehicle and Guard Rail Detection Using Radar and Vision Data Fusion , 2007, IEEE Transactions on Intelligent Transportation Systems.

[63]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[64]  船山 竜士,et al.  Robust (robust) interest point detector and descriptor , 2007 .

[65]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[66]  Klaus C. J. Dietmayer,et al.  Instantaneous lateral velocity estimation of a vehicle using Doppler radar , 2013, Proceedings of the 16th International Conference on Information Fusion.

[67]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[68]  Sanjit K. Mitra,et al.  Using saddle points for subpixel feature detection in camera calibration targets , 2002, Asia-Pacific Conference on Circuits and Systems.

[69]  Chin-Teng Lin,et al.  Construction of Fisheye Lens Inverse Perspective Mapping Model and Its Applications of Obstacle Detection , 2010, EURASIP J. Adv. Signal Process..

[70]  Jack Sklansky,et al.  Finding circles by an array of accumulators , 1975, Commun. ACM.

[71]  Minho Lee,et al.  Autonomous Detector Using Saliency Map Model and Modified Mean-Shift Tracking for a Blind Spot Monitor in a Car , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[72]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.