Experimental Comparison of Visual-Aided Odometry Methods for Rail Vehicles

Today, rail vehicle localization is based on infrastructure-side Balises (beacons) together with on-board odometry to determine whether a rail segment is occupied. Such a coarse locking leads to a sub-optimal usage of the rail networks. New railway standards propose the use of moving blocks centred around the rail vehicles to increase the capacity of the network. However, this approach requires accurate and robust position and velocity estimation of all vehicles. In this work, we investigate the applicability, challenges, and limitations of current visual and visual-inertial motion estimation frameworks for rail applications. An evaluation against real time kinematic-global position system ground truth is performed on multiple datasets recorded in industrial, sub-urban, and forest environments. Our results show that stereo visual-inertial odometry has a great potential to provide a precise motion estimation because of its complementing sensor modalities and shows superior performance in challenging situations compared to other frameworks.

[1]  Roland Siegwart,et al.  Appearance-based landmark selection for efficient long-term visual localization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Julie Beugin,et al.  A Survey of GNSS-Based Research and Developments for the European Railway Signaling , 2017, IEEE Transactions on Intelligent Transportation Systems.

[3]  Daniel Cremers,et al.  Direct Sparse Visual-Inertial Odometry Using Dynamic Marginalization , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Roland Siegwart,et al.  Absolute scale in structure from motion from a single vehicle mounted camera by exploiting nonholonomic constraints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[6]  Yohan Dupuis,et al.  Wheel odometry-based car localization and tracking on vectorial map , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[7]  Roland Siegwart,et al.  A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM , 2014, ICRA 2014.

[8]  Carsten Hasberg,et al.  Simultaneous Localization and Mapping for Path-Constrained Motion , 2012, IEEE Transactions on Intelligent Transportation Systems.

[9]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Agostino Martinelli,et al.  Closed-Form Solution of Visual-Inertial Structure from Motion , 2013, International Journal of Computer Vision.

[11]  Roland Siegwart,et al.  Monocular Visual-Inertial SLAM for Fixed-Wing UAVs Using Sliding Window Based Nonlinear Optimization , 2016, ISVC.

[12]  Daniel Cremers,et al.  Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  J. Tarel,et al.  All-Weather Vision for Automotive Safety: Which Spectral Band? , 2016, Advanced Microsystems for Automotive Applications 2018.

[14]  Wei Sun,et al.  Improving Observability of an Inertial System by Rotary Motions of an IMU , 2017, Sensors.

[15]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Colin Williams,et al.  The next ETCS Level? , 2016, 2016 IEEE International Conference on Intelligent Rail Transportation (ICIRT).

[17]  Yongduan Song,et al.  Intelligent Localization of a High-Speed Train Using LSSVM and the Online Sparse Optimization Approach , 2017, IEEE Transactions on Intelligent Transportation Systems.

[18]  Roland Siegwart,et al.  Maplab: An Open Framework for Research in Visual-Inertial Mapping and Localization , 2017, IEEE Robotics and Automation Letters.

[19]  Jürgen Wohlfeil,et al.  Vision based rail track and switch recognition for self-localization of trains in a rail network , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[20]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[21]  Navid Nourani-Vatani,et al.  Robust Odometry using Sensor Consensus Analysis , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Shaojie Shen,et al.  VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator , 2017, IEEE Transactions on Robotics.

[23]  Roland Siegwart,et al.  Visual-inertial self-calibration on informative motion segments , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Julie Beugin,et al.  Simulation-based evaluation of dependability and safety properties of satellite technologies for railway localization , 2012 .

[25]  Diego Herrero Murillas,et al.  Safe odometry for high-speed trains , 2016, 2016 IEEE International Conference on Intelligent Rail Transportation (ICIRT).

[26]  Salah Sukkarieh,et al.  Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions , 2012, IEEE Transactions on Robotics.

[27]  Alonzo Kelly,et al.  Linearized Error Propagation in Odometry , 2004, Int. J. Robotics Res..

[28]  Ingmar Posner,et al.  Driven to Distraction: Self-Supervised Distractor Learning for Robust Monocular Visual Odometry in Urban Environments , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Roland Siegwart,et al.  Automated valet parking and charging for e-mobility , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[30]  Monica Malvezzi,et al.  A localization algorithm for railway vehicles , 2015, 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[31]  Daniel Cremers,et al.  Direct Sparse Odometry , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Paul Newman,et al.  Shady dealings: Robust, long-term visual localisation using illumination invariance , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Roland Siegwart,et al.  Robust visual inertial odometry using a direct EKF-based approach , 2015, IROS 2015.

[34]  Hannes Sommer,et al.  The Two-State Implicit Filter Recursive Estimation for Mobile Robots , 2018, IEEE Robotics and Automation Letters.

[35]  Navid Nourani-Vatani,et al.  Automatic camera exposure control , 2007 .

[36]  Navid Nourani-Vatani,et al.  Correlation‐based visual odometry for ground vehicles , 2011, J. Field Robotics.

[37]  Max Spindler,et al.  Low power and low cost sensor for train velocity estimation , 2016, 2016 IEEE International Conference on Intelligent Rail Transportation (ICIRT).

[38]  Davide Scaramuzza,et al.  A Benchmark Comparison of Monocular Visual-Inertial Odometry Algorithms for Flying Robots , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Richard Altendorfer,et al.  Sensor fusion as an enabling technology for safety-critical driver assistance systems , 2010 .

[41]  Juan D. Tardós,et al.  Visual-Inertial Monocular SLAM With Map Reuse , 2016, IEEE Robotics and Automation Letters.

[42]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[43]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[44]  Winson S. Churchill Experience based navigation : theory, practice and implementation , 2012 .

[45]  Alfonso Bahillo,et al.  A Survey of Train Positioning Solutions , 2017, IEEE Sensors Journal.

[46]  Patrick Robertson,et al.  RailSLAM - Localization of rail vehicles and mapping of geometric railway tracks , 2013, 2013 IEEE International Conference on Robotics and Automation.