A Novel Vehicle Open Door Safety System Based on Cyclist Detection Using Fisheye Camera and Improved Deep Convolutional Generative Adversarial Nets

Due to the lack of observation of rear moving objects by the passenger or driver of a vehicle, accidents happen frequently when they open the door of the vehicle. In this paper, we propose a novel vehicle open door safety system based on cyclist detection using fisheye camera and Improved Deep Convolutional Generative Adversarial Nets (IDCGANs). First of all, a fisheye camera is automatically turned on and captures the rear information of the vehicle when the vehicle is stopping. After that, a simple and effective method based on longitude coordinate is used to correct the distorted images. Second, Improved Deep Convolutional Generative Adversarial Nets is used to generate sample for data training. As the limited training datasets of cyclist and lots of annotation information which takes much time and efforts, we use Improved Deep Convolutional Generative Adversarial Nets to generate synthesized images of cyclist and use them as the training data for cyclist detectors. At last, Faster R-CNN detector is employed to train and detect the cyclist. The system was tested on realistic experiments and reached 87.2% precision rate and 95.3% recall rate. The feasibility of the proposed system for vehicle open door safety is demonstrated through simulation and test results.

[1]  Hai Wang,et al.  A Radar-Based Door Open Warning Technology for Vehicle Active Safety , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[2]  Joon Hee Han,et al.  Local Decorrelation For Improved Pedestrian Detection , 2014, NIPS.

[3]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[5]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  H Johannsen,et al.  Investigation of Bicycle Accidents Involving Collisions with the Opening Door of Parking Vehicles and Demands for a Suitable Driver Assistance System , 2015 .

[9]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Stuart Vaughan Newstead,et al.  Cyclists and Open Vehicle Doors: Crash Characteristics and Risk Factors , 2013 .

[12]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.