Camera/Laser/GPS Fusion Method for Vehicle Positioning Under Extended NIS-Based Sensor Validation

Vehicle localization and autonomous navigation consist of precisely positioning a vehicle on road by the use of different kinds of sensors. This paper presents a vehicle localization method by integrating a stereoscopic system, a laser range finder (LRF) and a global localization sensor GPS. For more accurate LRF-based vehicle motion estimation, an outlier-rejection invariant closest point method (ICP) is proposed to reduce the matching ambiguities of scan alignment. The fusion approach starts by a sensor selection step that is applied to validate the coherence of the observations from different sensors. Then the information provided by the validated sensors is fused with an unscented information filter. To demonstrate its performance, the proposed multisensor localization method is tested with real data and evaluated by RTK-GPS data as ground truth. The fusion approach also facilitates the incorporation of more sensors if needed.

[1]  Cindy Cappelle,et al.  Localization of intelligent ground vehicles in outdoor urban environments using stereovision and GPS integration , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[2]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[3]  Andrea Censi,et al.  An accurate closed-form estimate of ICP's covariance , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Hugh F. Durrant-Whyte,et al.  Simultaneous Mapping and Localization with Sparse Extended Information Filters: Theory and Initial Results , 2004, WAFR.

[5]  Majura F. Selekwa,et al.  Parity Relation Based Fault Detection, Isolation and Reconfiguration for Autonomous Ground Vehicle Localization Sensors , 2004 .

[6]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[7]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[8]  Hyochoong Bang,et al.  Vision-based target motion estimation of multiple air vehicles using unscented information filter , 2010, ICCAS 2010.

[9]  Yuichi Motai,et al.  Improving Estimation of Vehicle's Trajectory Using the Latest Global Positioning System With Kalman Filtering , 2011, IEEE Transactions on Instrumentation and Measurement.

[10]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization and Mapping with Sparse Extended Information Filters , 2004, Int. J. Robotics Res..

[11]  Seong Yun Cho,et al.  Robust positioning technique in low-cost DR/GPS for land navigation , 2006, IEEE Transactions on Instrumentation and Measurement.

[12]  A. El-Rabbany.  Introduction to GPS: The Global Positioning System , 2002 .

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  A. Kandel,et al.  Multiple sensor based UGV localization using fuzzy extended Kalman filtering , 2007, 2007 Mediterranean Conference on Control & Automation.

[15]  Hugh Durrant-Whyte,et al.  Introduction to Decentralised Data Fusion , 2006 .

[16]  Larry H. Matthies,et al.  Visual odometry on the Mars Exploration Rovers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[17]  Christophe Boucher,et al.  A Hybrid Particle Approach for GNSS Applications With Partial GPS Outages , 2010, IEEE Transactions on Instrumentation and Measurement.

[18]  R. Jirawimut,et al.  Visual odometer for pedestrian navigation , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[19]  Maan El Badaoui El Najjar,et al.  A Road-Matching Method for Precise Vehicle Localization Using Belief Theory and Kalman Filtering , 2005, Auton. Robots.

[20]  Deok-Jin Lee,et al.  Nonlinear Estimation and Multiple Sensor Fusion Using Unscented Information Filtering , 2008, IEEE Signal Processing Letters.

[21]  Kurt Konolige,et al.  Large-Scale Visual Odometry for Rough Terrain , 2007, ISRR.

[22]  Andrea Cristofaro,et al.  Distributed Information Filters for MAV Cooperative Localization , 2010, DARS.

[23]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[24]  M. Jabbour,et al.  Management of Landmarks in a GIS for an Enhanced Localisation in Urban Areas , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[25]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[26]  Olivier Garcia-Favrot.  Laser Scanner Based Slam in Real Road and Traffic Environment , 2009 .

[27]  Cindy Cappelle,et al.  Unscented information filter based multi-sensor data fusion using stereo camera, laser range finder and GPS receiver for vehicle localization , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[28]  Nassir Navab,et al.  Estimation of Location Uncertainty for Scale Invariant Features Points , 2009, BMVC.

[29]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[30]  Larry H. Matthies,et al.  Visual odometry on the Mars exploration rovers - a tool to ensure accurate driving and science imaging , 2006, IEEE Robotics & Automation Magazine.