Leveraging Object Recognition in Reliable Vehicle Localization from Monocular Images

We present the processing pipeline of a monocular vision system that successfully performs the task of detecting, identifying and localizing a city bus electric charger station. This task is essential to the operation of an advanced driver assistance system that helps the driver to dock the long vehicle at the charging station. The focus is on the role of machine learning techniques in developing a robust detection and classification procedure that allows our system to localize the camera with respect to the charger even from long distances. We demonstrate that the learned detection procedure improves robustness of the vision techniques for monocular localization, while the geometric relations estimated by our system can be used to improve the learning results.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Juliette Marais,et al.  GNSS Position Integrity in Urban Environments: A Review of Literature , 2018, IEEE Transactions on Intelligent Transportation Systems.

[3]  Quanshi Zhang,et al.  Visual interpretability for deep learning: a survey , 2018, Frontiers of Information Technology & Electronic Engineering.

[4]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Delowar Hossain,et al.  Deep Learning-Based Landmark Detection for Mobile Robot Outdoor Localization , 2019, Machines.

[6]  Michal R. Nowicki,et al.  Laser-Based Localization and Terrain Mapping for Driver Assistance in a City Bus , 2019, AUTOMATION.

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Michel Dhome,et al.  Localization in urban environments: monocular vision compared to a differential GPS sensor , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  John F. Canny,et al.  Deep Traffic Light Detection for Self-driving Cars from a Large-scale Dataset , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[10]  Michal R. Nowicki,et al.  How to Improve Object Detection in a Driver Assistance System Applying Explainable Deep Learning , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[11]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[12]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[13]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.