It's like Déjà Vu all over again: Learning place-dependent terrain assessment for visual teach and repeat

This paper presents a learned, place-dependent terrain-assessment classifier that improves over time. Whereas typical methods aim to assess all of the terrain in a given environment, we exploit the fact that many robotic navigation tasks are well-suited to visual-teach-and-repeat navigation where robot motion is restricted to previously driven paths. In such scenarios, we argue that general terrain assessment is not required, and we can instead solve the much easier problem of detecting changes along the path; we sacrifice the ability to generalize off the path in favour of improved performance on the path. Terrain along a pretaught path is compared to terrain seen at the same location during previous, human-supervised traverses, and any significant differences cause that location to be labelled as unsafe. By storing all of our previous experiences, we are able to continuously improve our estimates as we revisit the same locations multiple times. We tested our method on two datasets collected at the University of Toronto and show that we improve over existing place-independent (both learned and not) methods, enabling nearly full autonomy in challenging, varied terrain using only a stereo camera.

[1]  Larry D. Jackel,et al.  The DARPA LAGR program: Goals, challenges, methodology, and phase I results , 2006, J. Field Robotics.

[2]  E. Mjolsness,et al.  Learning for autonomous navigation : extrapolating from underfoot to the far field , 2005 .

[3]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[4]  Aaron C. Courville,et al.  Interacting Markov Random Fields for Simultaneous Terrain Modeling and Obstacle Detection , 2005, Robotics: Science and Systems.

[5]  Winston Churchill,et al.  Experience-based navigation for long-term localisation , 2013, Int. J. Robotics Res..

[6]  Tim D. Barfoot,et al.  Learning to assess terrain from human demonstration using an introspective Gaussian-process classifier , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Ingmar Posner,et al.  Wrong Today, Right Tomorrow: Experience-Based Classification for Robot Perception , 2015, FSR.

[8]  Anthony Stentz,et al.  Learning Predictions of the Load-Bearing Surface for Autonomous Rough-Terrain Navigation in Vegetation , 2003, FSR.

[9]  Roland Siegwart,et al.  Generative object detection and tracking in 3D range data , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Larry Matthies,et al.  Stereo vision and rover navigation software for planetary exploration , 2002, Proceedings, IEEE Aerospace Conference.

[11]  Steven Dubowsky,et al.  Online terrain parameter estimation for wheeled mobile robots with application to planetary rovers , 2004, IEEE Transactions on Robotics.

[12]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[13]  Angela P. Schoellig,et al.  Learning-based nonlinear model predictive control to improve vision-based mobile robot path-tracking in challenging outdoor environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Wolfram Burgard,et al.  Mobile Robot Map Learning from Range Data in Dynamic Environments , 2007 .

[15]  Pietro Perona,et al.  Learning and prediction of slip from visual information , 2007, J. Field Robotics.

[16]  Pietro Perona,et al.  Learning slip behavior using automatic mechanical supervision , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Larry H. Matthies,et al.  Learning long-range terrain classification for autonomous navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[18]  Roland Siegwart,et al.  Long-term 3D map maintenance in dynamic environments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Ahmad Kamal Aijazi,et al.  Automatic Removal of Imperfections and Change Detection for Accurate 3D Urban Cartography by Classification and Incremental Updating , 2013, Remote. Sens..

[20]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization, Mapping and Moving Object Tracking , 2007, Int. J. Robotics Res..

[21]  Karl Murphy,et al.  Autonomous Mobility for the Demo III Experimental Unmanned Vehicles , 2002 .

[22]  Larry H. Matthies,et al.  Autonomous off‐road navigation with end‐to‐end learning for the LAGR program , 2009, J. Field Robotics.

[23]  Pietro Perona,et al.  Learning to predict slip for ground robots , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Anthony Stentz,et al.  Online adaptive rough-terrain navigation vegetation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[25]  Michael I. Jordan,et al.  Learning with Mixtures of Trees , 2001, J. Mach. Learn. Res..

[26]  Steven Dubowsky,et al.  On-line terrain parameter estimation for planetary rovers , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[27]  Paul Timothy Furgale,et al.  Visual teach and repeat for long‐range rover autonomy , 2010, J. Field Robotics.