Mobile Device Based Outdoor Navigation with On-Line Learning Neural Network: A Comparison with Convolutional Neural Network

Outdoor navigation is challenging with its dynamic environments and huge appearance variances. Traditional autonomous navigation systems construct 3D driving scenes to recognize open and occupied voxels by using laser range scanners, which are not available on mobile devices. Existing image-based navigationmethods, on the other hand, are costly in computation and thus cannot be deployed onto a mobile device. To overcome these difficulties, we present an on-line learning neural network for real-time outdoor navigation using only the computational resources available on a standard android mobile device (i.e. camera, GPS, and no cloud back-end). The network is trained to recognize the most relevant object in current navigation setting and make corresponding decisions (i.e. adjust direction, avoid obstacles, and follow GPS). The network is compared with state of the art image classifier, the Convolutional Neural Network, in various aspects (i.e. network size, number of updates, convergence speed and final performance). Comparisons show that our network requires a minimal number of updates and converges significantly faster to better performance. The network successfully navigated in regular long-duration testing in novel settings and blindfolded testing under sunny and cloudy weather conditions.

[1]  Charles E. Thorpe,et al.  SCARF: a color vision system that tracks roads and intersections , 1993, IEEE Trans. Robotics Autom..

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[5]  Juyang Weng,et al.  Dually Optimal Neuronal Layers: Lobe Component Analysis , 2009, IEEE Transactions on Autonomous Mental Development.

[6]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  Juyang Weng,et al.  Top–Down Connections in Self-Organizing Hebbian Networks: Topographic Class Grouping , 2010, IEEE Transactions on Autonomous Mental Development.

[8]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[9]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[10]  Yann LeCun,et al.  Convolutional neural networks applied to house numbers digit classification , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[12]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[13]  Juyang Weng,et al.  Approaching Camera-based Real-World Navigation Using Object Recognition , 2015, INNS Conference on Big Data.

[14]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[15]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.