Unsupervised Learning of Metric Representations with Slow Features from Omnidirectional Views

Unsupervised learning of Self-Localization with Slow Feature Analysis (SFA) using omnidirectional camera input has been shown to be a viable alternative to established SLAM approaches. Previous models for SFA self-localization purely relied on omnidirectional visual input. The model led to globally consistent localization in SFA space but the lack of odometry integration reduced the local accuracy. However, odometry integration and other downstream usage of localization require a common coordinate system, which previously was based on an external metric ground truth measurement system. Here, we show an autonomous unsupervised approach to generate accurate metric representations from SFA outputs without external sensors. We assume locally linear trajectories of a robot, which is consistent with, for example, driving patterns of robotic lawn mowers. This geometric constraint allows a formulation of an optimization problem for the regression from slow feature values to the robot’s position. We show that the resulting accuracy on test data is comparable to supervised regression based on external sensors. Based on this result, using a Kalman filter for fusion of SFA localization and odometry is shown to further increase localization accuracy over the supervised regression model.

[1]  P. König,et al.  A Model of the Ventral Visual System Based on Temporal Stability and Local Memory , 2006, PLoS biology.

[2]  Daniel D. Lee,et al.  Learning nonlinear appearance manifolds for robot localization , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Ute Bauer-Wersing,et al.  Robust Outdoor Self-localization In Changing Environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Laurenz Wiskott,et al.  Slowness and Sparseness Lead to Place, Head-Direction, and Spatial-View Cells , 2007, PLoS Comput. Biol..

[5]  Ute Bauer-Wersing,et al.  Improving Robustness of Slow Feature Analysis Based Localization Using Loop Closure Events , 2016, ICANN.

[6]  Ute Bauer-Wersing,et al.  Efficient navigation using slow feature gradients , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Benjamin Schrauwen,et al.  Learning slow features with reservoir computing for biologically-inspired robot localization , 2012, Neural Networks.

[8]  Ute Bauer-Wersing,et al.  Outdoor Self-Localization of a Mobile Robot Using Slow Feature Analysis , 2013, ICONIP.

[9]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[10]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[12]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ute Bauer-Wersing,et al.  Bio-inspired visual self-localization in real world scenarios using Slow Feature Analysis , 2018, PloS one.

[14]  Roberto Cipolla,et al.  PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[16]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[17]  Ute Bauer-Wersing,et al.  Robot Navigation on Slow Feature Gradients , 2018, ICONIP.

[18]  Niko Wilbert,et al.  Modular Toolkit for Data Processing (MDP): A Python Data Processing Framework , 2008, Frontiers Neuroinformatics.

[19]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[20]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Alonzo Kelly,et al.  A 3D State Space Formulation of a Navigation Kalman Filter for Autonomous Vehicles , 1994 .