Estimation of Vehicle Pose and Position with Monocular Camera at Urban Road Intersections

With the rapid development of urban, the scale of the city is expanding day by day. The road environment is becoming more and more complicated. The vehicle ego-localization in complex road environment puts forward imperative requirements for intelligent driving technology. The reliable vehicle ego-localization, including the lane recognition and the vehicle position and attitude estimation, at the complex traffic intersection is significant for the intelligent driving of the vehicle. In this article, we focus on the complex road environment of the city, and propose a pose and position estimation method based on the road sign using only a monocular camera and a common GPS (global positioning system). Associated with the multi-sensor cascade system, this method can be a stable and reliable alternative when the precision of multi-sensor cascade system decreases. The experimental results show that, within 100 meters distance to the road signs, the pose error is less than 2 degrees, and the position error is less than one meter, which can reach the lane-level positioning accuracy. Through the comparison with the Beidou high-precision positioning system L202, our method is more accurate for detecting which lane the vehicle is driving on.

[1]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[2]  Raja Sengupta,et al.  Kalman Filter-Based Integration of DGPS and Vehicle Sensors for Localization , 2005, IEEE Transactions on Control Systems Technology.

[3]  F. Chausse,et al.  Vehicle localization on a digital map using particles filtering , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Reinhard Klette,et al.  General traffic sign recognition by feature matching , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[5]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[6]  K. Gulez,et al.  Evaluations of different Simultaneous Localization and Mapping (SLAM) algorithms , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[7]  Sedigheh Ghofrani,et al.  Traffic Road Sign Detection and Classification , 2012 .

[8]  N. H. C. Yung,et al.  Lane detection by orientation and length discrimination , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Sergiu Nedevschi,et al.  Accurate Ego-Vehicle Global Localization at Intersections Through Alignment of Visual Data With Digital Map , 2013, IEEE Transactions on Intelligent Transportation Systems.

[11]  Axel Pinz,et al.  Globally Optimal O(n) Solution to the PnP Problem for General Camera Models , 2008, BMVC.

[12]  Yasmine A. Fahmy,et al.  Two-way TOA with limited dead reckoning for GPS-free vehicle localization using single RSU , 2013, 2013 13th International Conference on ITS Telecommunications (ITST).

[13]  Robert Odolinski,et al.  Instantaneous BeiDou+GPS RTK positioning with high cut-off elevation angles , 2014, Journal of Geodesy.

[14]  D. Powell,et al.  Land-vehicle navigation using GPS , 1999, Proc. IEEE.

[15]  Julius Ziegler,et al.  Urban localization with camera and inertial measurement unit , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[16]  Cindy Cappelle,et al.  Camera/Laser/GPS Fusion Method for Vehicle Positioning Under Extended NIS-Based Sensor Validation , 2013, IEEE Transactions on Instrumentation and Measurement.

[17]  Hui Chen,et al.  Lane detection algorithm based on geometric moment sampling , 2017 .

[18]  Sridhar Lakshmanan,et al.  An algorithm for detecting roads and obstacles in radar images , 2001, IEEE Trans. Veh. Technol..

[19]  Leopoldo Armesto,et al.  Robust and Efficient Mobile Robot Self-localization using Laser Scanner and Geometrical Maps , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Sridhar Lakshmanan,et al.  A Deformable Template Approach to Detecting Straight Edges in Radar Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Kostas Daniilidis,et al.  Linear Pose Estimation from Points or Lines , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Hansye S. Dulimart,et al.  Mobile robot localization in indoor environment , 1997, Pattern Recognit..

[23]  Mohamed El Ansari,et al.  Traffic sign detection and recognition based on random forests , 2016, Appl. Soft Comput..

[24]  Baoxing Bai,et al.  Research on GPRS vehicle location network service system , 2010, 2010 International Conference on Computer, Mechatronics, Control and Electronic Engineering.

[25]  Qi Wang,et al.  An Incremental Framework for Video-Based Traffic Sign Detection, Tracking, and Recognition , 2017, IEEE Transactions on Intelligent Transportation Systems.

[26]  Jing Peng,et al.  Virtual 3D city model for intelligent vehicle geo-localization , 2009, 2009 9th International Conference on Intelligent Transport Systems Telecommunications, (ITST).

[27]  Marcin Skoczylas,et al.  Recognition of multiple traffic signs using keypoints feature detectors , 2016, 2016 International Conference and Exposition on Electrical and Power Engineering (EPE).

[28]  Hiroshi Murase,et al.  Single camera vehicle localization using SURF scale and dynamic time warping , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.