STMVO: biologically inspired monocular visual odometry

Visual odometry (VO) is a fundamental and challenging problem in both the computer vision community and the robotics community. VO refers the process of recovering the relative movements of a camera by analyzing the associated image sequence. While VO is generally formulated as descriptors-based feature tracking with outliers rejection and global optimization, these algorithms are not only computationally expensive but also lack robustness. In the paper, a biologically inspired solution to the monocular visual odometry problem was presented, which was named as shunting short-term memory monocular visual odometry. The proposed method is simple and concise in both concept and implementation. To be more specific, it utilizes the shunting short-term memory to represent the key frames and the latest observations and also to adapt to uncertainties and ambiguities. And scan matching scheme is adopted to search the movement that best explained the difference between the latest observation and the key frame. Because of the dynamic properties of the neural network, the proposed method requires neither explicit extraction of features and descriptors, nor outliers detection and bundle optimization. Theoretical analysis in the paper showed that the proposed method has Lyapunov stability and constant computational complexity. The proposed method was also compared with the classical monocular VO algorithm in real indoor environments, and the experimental results proved that the proposed method outperforms the classical method on both effectiveness and robustness.

[1]  Zheng Wang,et al.  Using Laplacian Eigenmap as Heuristic Information to Solve Nonlinear Constraints Defined on a Graph and Its Application in Distributed Range-Free Localization of Wireless Sensor Networks , 2013, Neural Processing Letters.

[2]  Sam Kwong,et al.  Efficient Motion and Disparity Estimation Optimization for Low Complexity Multiview Video Coding , 2015, IEEE Transactions on Broadcasting.

[3]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[4]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[5]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Shuai Li,et al.  Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks , 2012, Neural Computing and Applications.

[7]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Naixue Xiong,et al.  Steganalysis of LSB matching using differences between nonadjacent pixels , 2016, Multimedia Tools and Applications.

[9]  Ian D. Reid,et al.  On combining visual SLAM and visual odometry , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Xingming Sun,et al.  Segmentation-Based Image Copy-Move Forgery Detection Scheme , 2015, IEEE Transactions on Information Forensics and Security.

[11]  Shuai Li,et al.  A biologically inspired solution to simultaneous localization and consistent mapping in dynamic environments , 2013, Neurocomputing.

[12]  Edwin Olson,et al.  Structure tensors for general purpose LIDAR feature extraction , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[14]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[15]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Shuai Li,et al.  Selective Positive–Negative Feedback Produces the Winner-Take-All Competition in Recurrent Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Shukai Duan,et al.  Small-world Hopfield neural networks with weight salience priority and memristor synapses for digit recognition , 2015, Neural Computing and Applications.

[18]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[19]  Gang Chen,et al.  Color Image Analysis by Quaternion-Type Moments , 2014, Journal of Mathematical Imaging and Vision.

[20]  Roland Siegwart,et al.  Appearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles , 2008, IEEE Transactions on Robotics.

[21]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Hai Liu,et al.  Fast and Robust Data Association Using Posterior Based Approximate Joint Compatibility Test , 2014, IEEE Transactions on Industrial Informatics.

[23]  Bin Gu,et al.  Incremental learning for ν-Support Vector Regression , 2015, Neural Networks.

[24]  Xu Wang,et al.  Spiking neural network-based target tracking control for autonomous mobile robots , 2015, Neural Computing and Applications.

[25]  Edwin Olson,et al.  IPJC: The Incremental Posterior Joint Compatibility test for fast feature cloud matching , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[27]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[28]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[29]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[30]  Hareton K. N. Leung,et al.  A Highly Efficient Approach to Protein Interactome Mapping Based on Collaborative Filtering Framework , 2015, Scientific Reports.

[31]  Liping Chen,et al.  Finite-time stability criteria for a class of fractional-order neural networks with delay , 2015, Neural Computing and Applications.

[32]  Ann A. Ferguson,et al.  What makes up plant genomes: The vanishing line between transposable elements and genes. , 2016, Biochimica et biophysica acta.

[33]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.