Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network

Accurate lane localization and lane change detection are crucial in advanced driver assistance systems and autonomous driving systems for safer and more efficient trajectory planning. Conventional localization devices such as Global Positioning System only provide road-level resolution for car navigation, which is incompetent to assist in lane-level decision making. The state of art technique for lane localization is to use Light Detection and Ranging sensors to correct the global localization error and achieve centimeter-level accuracy, but the real-time implementation and popularization for LiDAR is still limited by its computational burden and current cost. As a cost-effective alternative, vision-based lane change detection has been highly regarded for affordable autonomous vehicles to support lane-level localization. A deep learning based computer vision system is developed to detect the lane change behavior using the images captured by a front-view camera mounted on the vehicle and data from the inertial measurement unit for highway driving. Testing results on real-world driving data have shown that the proposed method is robust with real-time working ability and could achieve around 87% lane change detection accuracy. Compared to the average human reaction to visual stimuli, the proposed computer vision system works 9 times faster, which makes it capable of helping make life-saving decisions in time.

[1]  Grace Xingxin Gao,et al.  Covariance Estimation for GPS-LiDar Sensor Fusion for UAVs , 2017 .

[2]  Otman A. Basir,et al.  GPS Localization Accuracy Classification: A Context-Based Approach , 2013, IEEE Transactions on Intelligent Transportation Systems.

[3]  Jing-Fu Liu,et al.  Development of a Vision-Based Driver Assistance System with Lane Departure Warning and Forward Collision Warning Functions , 2008, 2008 Digital Image Computing: Techniques and Applications.

[4]  Vidya N. Murali,et al.  DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Elliott D. Kaplan.  Understanding GPS : principles and applications , 1996 .

[6]  Ricardo Pio Monti,et al.  Avoiding Degradation in Deep Feed-Forward Networks by Phasing Out Skip-Connections , 2018, ICANN.

[7]  E. Krakiwsky,et al.  A Kalman filter for integrating dead reckoning, map matching and GPS positioning , 1988, IEEE PLANS '88.,Position Location and Navigation Symposium, Record. 'Navigation into the 21st Century'..

[8]  Iljoo Baek,et al.  Vehicles Lane-changing Behavior Detection , 2018, ArXiv.

[9]  Takatsugu Hirayama,et al.  Integrated modeling of driver gaze and vehicle operation behavior to estimate risk level during lane changes , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[10]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[11]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Lei Zhao,et al.  Vision-Based Lane Departure Detection Using a Stacked Sparse Autoencoder , 2018, Mathematical Problems in Engineering.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Andrey Soloviev,et al.  Integration of GPS and vision measurements for navigation in GPS challenged environments , 2010, IEEE/ION Position, Location and Navigation Symposium.

[16]  Xiangjing An,et al.  A Novel Approach to Provide Lane Departure Warning Using Only One Forward-Looking Camera , 2006, International Symposium on Collaborative Technologies and Systems (CTS'06).

[17]  Ichiro Ide,et al.  ITS+DM Hackathon (ITSC 2017): Lane Departure Prediction With Naturalistic Driving Data , 2019, IEEE Intelligent Transportation Systems Magazine.

[18]  C.R. Jung,et al.  A lane departure warning system using lateral offset with uncalibrated camera , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..