A Low Cost Vision-Based Road-Following System for Mobile Robots

Navigation is necessary for autonomous mobile robots that need to track the roads in outdoor environments. These functions could be achieved by fusing data from costly sensors, such as GPS/IMU, lasers and cameras. In this paper, we propose a novel method for road detection and road following without prior knowledge, which is more suitable with small single lane roads. The proposed system consists of a road detection system and road tracking system. A color-based road detector and a texture line detector are designed separately and fused to track the target in the road detection system. The top middle area of the road detection result is regarded as the road-following target and is delivered to the road tracking system for the robot. The road tracking system maps the tracking position in camera coordinates to position in world coordinates, which is used to calculate the control commands by the traditional tracking controllers. The robustness of the system is enhanced with the development of an Unscented Kalman Filter (UKF). The UKF estimates the best road borders from the measurement and presents a smooth road transition between frame to frame, especially in situations such as occlusion or discontinuous roads. The system is tested to achieve a recognition rate of about 98.7% under regular illumination conditions and with minimal road-following error within a variety of environments under various lighting conditions.

[1]  Jianwu Fang,et al.  Adaptive road detection via context-aware label transfer , 2015, Neurocomputing.

[2]  Xiang Chen,et al.  Road segmentation via iterative deep analysis , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[3]  Torsten Sattler,et al.  Obstacle detection for self-driving cars using only monocular cameras and wheel odometry , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Liam Paull,et al.  Autonomous Vehicle Navigation in Rural Environments Without Detailed Prior Maps , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[5]  G. Avi,et al.  Lane Extraction and Tracking for Robot Navigation in Agricultural Applications , 2003 .

[6]  Robert C. Bolles,et al.  Localization and Mapping for Autonomous Navigation in Outdoor Terrains : A Stereo Vision Approach , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[7]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[8]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..

[9]  Rafael Grompone von Gioi,et al.  Vanishing Point Detection in Urban Scenes Using Point Alignments , 2017, Image Process. Line.

[10]  Huosheng Hu,et al.  Real-time road detection and description for robot navigation in an unstructured campus environment , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[11]  Wang Yanqing,et al.  Vision-Based Road Detection by Monte Carlo Method , 2010 .

[12]  Sukhan Lee,et al.  Clothoids Composition Method for Smooth Path Generation of Car-Like Vehicle Navigation , 2017, J. Intell. Robotic Syst..

[13]  Wolfram Burgard,et al.  Improving robot navigation in structured outdoor environments by identifying vegetation from laser data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Dacheng Tao,et al.  Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Hong Xu,et al.  A Novel Vehicle Reversing Speed Control Based on Obstacle Detection and Sparse Representation , 2015, IEEE Transactions on Intelligent Transportation Systems.

[16]  Rui Liu,et al.  Real-time obstacle detection with motion features using monocular vision , 2014, The Visual Computer.

[17]  Sang Wook Lee,et al.  Vision-based adaptive and recursive tracking of unpaved roads , 2002, Pattern Recognit. Lett..

[18]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Daniel Maier,et al.  Real-time navigation in 3D environments based on depth camera data , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[20]  Shengyan Zhou,et al.  Self-supervised learning method for unstructured road detection using Fuzzy Support Vector Machines , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Frédéric Labrosse,et al.  Automatic Driving on Ill‐defined Roads: An Adaptive, Shape‐constrained, Color‐based Method , 2015, J. Field Robotics.

[22]  Illah R. Nourbakhsh,et al.  Appearance-Based Obstacle Detection with Monocular Color Vision , 2000, AAAI/IAAI.

[23]  Keita Kurashiki,et al.  Visual Navigation of a Wheeled Mobile Robot Using Front Image in Semi-Structured Environment , 2015, J. Robotics Mechatronics.

[24]  Qi Wang,et al.  Video-based road detection via online structural learning , 2015, Neurocomputing.

[25]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.