Robot – Enabled Lakeshore Monitoring Using Visual SLAM and SIFT Flow

This paper establishes an autonomous monitoring framework to augment a human’s ability to detect changes in lakeshore environments. This is a large spatial and temporal scale study, which analyzes data from eight different surveys of a lakeshore collected over 11 months with an autonomous surface vehicle. Despite the variation in appearance across surveys, our framework provides a human with aligned images and a way to readily detect changes between them. First visual SLAM is used to find a coarse alignment of images between surveys, and second, SIFT Flow is applied to achieve dense correspondence. The aligned images are flickered back-and-forth in a user display, which enables a human to rapidly detect changes. Results show our method can align images in the midst of variation in appearance of the sky, the water, changes in objects on a lakeshore, and the seasonal changes of plants.

[1]  Cédric Pradalier,et al.  Towards Autonomous Lakeshore Monitoring , 2014, ISER.

[2]  Niko Sünderhauf,et al.  Superpixel-based appearance change prediction for long-term navigation across seasons , 2014, Robotics Auton. Syst..

[3]  Gaurav S. Sukhatme,et al.  Obstacle detection from overhead imagery using self-supervised learning for Autonomous Surface Vehicles , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[5]  F. Dellaert Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .

[6]  Roland Siegwart,et al.  State Estimation for Shore Monitoring Using an Autonomous Surface Vessel , 2014, ISER.

[7]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Richard S. Zemel,et al.  Topological map learning from outdoor image sequences , 2006, J. Field Robotics.

[10]  Paul Newman,et al.  Scene Signatures: Localised and Point-less Features for Localisation , 2014, Robotics: Science and Systems.

[11]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[12]  Peter I. Corke,et al.  Dealing with shadows: Capturing intrinsic scene appearance for image-based outdoor localisation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Guang-Zhong Yang,et al.  Feature Co-occurrence Maps: Appearance-based localisation throughout the day , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Frank Dellaert,et al.  Eliminating conditionally independent sets in factor graphs: A unifying perspective based on smart factors , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Gordon Wyeth,et al.  FAB-MAP + RatSLAM: Appearance-based SLAM for multiple times of day , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Frank Dellaert,et al.  Tectonic SAM: Exact, Out-of-Core, Submap-Based SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.