Real-Time Egocentric Navigation Using 3D Sensing

This chapter proposes a hierarchical navigation system combining the benefits of perception space local planning and allocentric global planning. Perception space permits computationally efficient 3D collision checking, enabling safe navigation in environments that do not meet the conditions assumed by traditional navigation systems based on planar laser scans. Contributions include approaches for scoring and collision checking trajectories in perception space. Benchmarking results show the advantages of perception space collision checking over popular alternatives in the context of real-time local planning. Simulated experiments with multiple robotic platforms in several environments demonstrate the importance of 3D collision checking and the utility of a mixed representation hierarchical navigation system.

[1]  Wendelin Feiten,et al.  Steer angle fields: An approach to robust manoeuvring in cluttered, unknown environments , 1994, Robotics Auton. Syst..

[2]  Javier Minguez,et al.  Nearness diagram (ND) navigation: collision avoidance in troublesome scenarios , 2004, IEEE Transactions on Robotics and Automation.

[3]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[4]  Quang-Cuong Pham,et al.  A General, Fast, and Robust Implementation of the Time-Optimal Path Parameterization Algorithm , 2013, IEEE Transactions on Robotics.

[5]  Daniel D. Dilks,et al.  The Occipital Place Area Is Causally and Selectively Involved in Scene Perception , 2013, The Journal of Neuroscience.

[6]  Francesco Bullo,et al.  Smooth Nearness-Diagram Navigation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Bärbel Mertsching,et al.  The admissible gap (AG) method for reactive collision avoidance , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Wendy Flores-Fuentes,et al.  Exact laser beam positioning for measurement of vegetation vitality , 2017, Ind. Robot.

[10]  Oussama Khatib,et al.  Elastic bands: connecting path planning and control , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[11]  Michelle R. Greene,et al.  Recognition of natural scenes from global properties: Seeing the forest without representing the trees , 2009, Cognitive Psychology.

[12]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[13]  Don Ray Murray,et al.  Stereo vision based mapping and navigation for mobile robots , 1997, Proceedings of International Conference on Robotics and Automation.

[14]  Daniel Maier,et al.  Real-time navigation in 3D environments based on depth camera data , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[15]  Nidhi Kalra,et al.  Replanning with RRTs , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[17]  Torsten Bertram,et al.  Integrated online trajectory planning and optimization in distinctive topologies , 2017, Robotics Auton. Syst..

[18]  Javier Minguez,et al.  Nearness diagram navigation (ND): a new real time collision avoidance approach , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[19]  Daniel P. Huttenlocher,et al.  Distance Transforms of Sampled Functions , 2012, Theory Comput..

[20]  Sven Koenig,et al.  Fast replanning for navigation in unknown terrain , 2005, IEEE Transactions on Robotics.

[21]  Brett R. Fajen,et al.  Guiding locomotion in complex, dynamic environments , 2013, Front. Behav. Neurosci..

[22]  Yoram Koren,et al.  The vector field histogram-fast obstacle avoidance for mobile robots , 1991, IEEE Trans. Robotics Autom..

[23]  Matthew Kelly,et al.  An Introduction to Trajectory Optimization: How to Do Your Own Direct Collocation , 2017, SIAM Rev..

[24]  Volkan Sezer,et al.  A novel obstacle avoidance algorithm: "Follow the Gap Method" , 2012, Robotics Auton. Syst..

[25]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[26]  Patricio A. Vela,et al.  PiPS: Planning in perception space , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Wendelin Feiten,et al.  Robust obstacle avoidance in unknown and cramped environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[28]  Lydia E. Kavraki,et al.  Path planning using lazy PRM , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[29]  Manuela M. Veloso,et al.  Depth camera based indoor mobile robot localization and navigation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[30]  James E. Cutting,et al.  How we avoid collisions with stationary and moving objects. , 1995 .

[31]  Osamu Takahashi,et al.  Motion planning in a plane using generalized Voronoi diagrams , 1989, IEEE Trans. Robotics Autom..

[32]  Minoru Asada,et al.  Adaptive binocular visual servoing for independently moving target tracking , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[33]  Patricio A. Vela,et al.  A New Framework for Optimal Path Planning of Rectangular Robots Using a Weighted $L_p$ Norm , 2017, IEEE Robotics and Automation Letters.

[34]  Sebastian Thrun,et al.  Anytime search in dynamic graphs , 2008, Artif. Intell..

[35]  I. Michael Ross,et al.  A review of pseudospectral optimal control: From theory to flight , 2012, Annu. Rev. Control..

[36]  Emmanouil Tsardoulias,et al.  A Review of Global Path Planning Methods for Occupancy Grid Maps Regardless of Obstacle Density , 2016, J. Intell. Robotic Syst..

[37]  Patricio A. Vela,et al.  Optimal obstacle avoidance trajectory generation using the root locus principle , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[38]  Wendy Flores-Fuentes,et al.  Mobile Robot Path Planning Using Continuous Laser Scanning , 2019 .

[39]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[40]  Russell A. Epstein.  Parahippocampal and retrosplenial contributions to human spatial navigation , 2008, Trends in Cognitive Sciences.

[41]  Daniel E. Koditschek,et al.  Exact robot navigation using artificial potential functions , 1992, IEEE Trans. Robotics Autom..

[42]  Timothy Bretl,et al.  Using Motion Primitives in Probabilistic Sample-Based Planning for Humanoid Robots , 2008, WAFR.

[43]  Emilio Frazzoli,et al.  RRTX: Real-Time Motion Planning/Replanning for Environments with Unpredictable Obstacles , 2014, WAFR.

[44]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods/ J. A. Sethian , 1999 .

[45]  Wolfram Burgard,et al.  The Mobile Robot Rhino , 1995, SNN Symposium on Neural Networks.

[46]  Gregory Z. Grudic,et al.  Local path planning in image space for autonomous robot navigation in unstructured environments , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Manuela M. Veloso,et al.  Real-Time Randomized Path Planning for Robot Navigation , 2002, RoboCup.

[48]  Wilmar Hernandez,et al.  Individual Scans Fusion in Virtual Knowledge Base for Navigation of Mobile Robotic Group with 3D TVS , 2018, IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society.

[49]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[50]  Hilbert J. Kappen,et al.  Efficient Optical Flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone , 2016, IEEE Robotics and Automation Letters.

[51]  Bärbel Mertsching,et al.  Closest Gap based (CG) reactive obstacle avoidance Navigation for highly cluttered environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[53]  Norman I. Badler,et al.  GPU-based dynamic search on adaptive resolution grids , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[54]  Daniel D. Dilks,et al.  Places in the Brain: Bridging Layout and Object Geometry in Scene-Selective Cortex , 2018, Cerebral cortex.

[55]  Andrei Tchernykh,et al.  Data transferring model determination in robotic group , 2016, Robotics Auton. Syst..

[56]  Russell A. Epstein,et al.  Coding of navigational affordances in the human visual system , 2017, Proceedings of the National Academy of Sciences.

[57]  Jonathan P. How,et al.  Aggressive 3-D collision avoidance for high-speed navigation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[58]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[59]  Daniel E. Koditschek,et al.  Exact robot navigation using power diagrams , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[61]  Emilio Frazzoli,et al.  Real-Time Motion Planning for Agile Autonomous Vehicles , 2000 .

[62]  B. J. Clark,et al.  Interaction of Egocentric and World-Centered Reference Frames in the Rat Posterior Parietal Cortex , 2014, The Journal of Neuroscience.

[63]  Jae Wook Jeon,et al.  FPGA Design and Implementation of a Real-Time Stereo Vision System , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[64]  Alain Berthoz,et al.  A fronto-parietal system for computing the egocentric spatial frame of reference in humans , 1999, Experimental Brain Research.

[65]  Iwan Ulrich,et al.  VFH/sup */: local obstacle avoidance with look-ahead verification , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[66]  Jonathan P. How,et al.  Motion planning for urban driving using RRT , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  Reid G. Simmons,et al.  The curvature-velocity method for local obstacle avoidance , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[68]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[69]  Chen Yang,et al.  High throughput hardware architecture for accurate semi-global matching , 2017, 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC).

[70]  Lydia E. Kavraki,et al.  Analysis of probabilistic roadmaps for path planning , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[71]  Leo Hartman,et al.  Anytime dynamic path-planning with flexible probabilistic roadmaps , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[72]  Munther A. Dahleh,et al.  Maneuver-based motion planning for nonlinear systems with symmetries , 2005, IEEE Transactions on Robotics.

[73]  Javier Minguez,et al.  Global nearness diagram navigation (GND) , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[74]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[75]  Larry H. Matthies,et al.  Stereo vision-based obstacle avoidance for micro air vehicles using disparity space , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[76]  Wolfram Burgard,et al.  An Experimental Protocol for Benchmarking Robotic Indoor Navigation , 2014, ISER.

[77]  Yoram Koren,et al.  Real-time obstacle avoidance for fact mobile robots , 1989, IEEE Trans. Syst. Man Cybern..

[78]  Robin Deits,et al.  Efficient mixed-integer planning for UAVs in cluttered environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[79]  Byron Boots,et al.  Continuous-time Gaussian process motion planning via probabilistic inference , 2017, Int. J. Robotics Res..

[80]  Bärbel Mertsching,et al.  Safe Gap based (SG) reactive navigation for mobile robots , 2013, 2013 European Conference on Mobile Robots.

[81]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[82]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[83]  Guangming Xiong,et al.  VPH+: An Enhanced Vector Polar Histogram Method for Mobile Robot Obstacle Avoidance , 2007, 2007 International Conference on Mechatronics and Automation.

[84]  Andrew J. Barry.  High‐speed autonomous obstacle avoidance with pushbroom stereo , 2018, J. Field Robotics.

[85]  James J. Kuffner,et al.  Multipartite RRTs for Rapid Replanning in Dynamic Environments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[86]  Wolfram Burgard,et al.  An integrated approach to goal-directed obstacle avoidance under dynamic constraints for dynamic environments , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[87]  Dinesh Manocha,et al.  FCL: A general purpose library for collision and proximity queries , 2012, 2012 IEEE International Conference on Robotics and Automation.

[88]  Jur P. van den Berg,et al.  Anytime path planning and replanning in dynamic environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[89]  E. Spelke,et al.  Updating egocentric representations in human navigation , 2000, Cognition.

[90]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[91]  A. Berthoz,et al.  The neural basis of egocentric and allocentric coding of space in humans: a functional magnetic resonance study , 2000, Experimental Brain Research.

[92]  Michael Suppa,et al.  Stereo vision based indoor/outdoor navigation for flying robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[93]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[94]  Oliver Brock,et al.  High-speed navigation using the global dynamic window approach , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[95]  Alonzo Kelly,et al.  Kinodynamic motion planning with state lattice motion primitives , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[96]  Gaurav S. Sukhatme,et al.  Combined optic-flow and stereo-based navigation of urban canyons for a UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[97]  Hong Wang,et al.  VPH: a new laser radar based obstacle avoidance method for intelligent mobile robots , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[98]  Anthony T. Fragoso,et al.  Stereo vision-based obstacle avoidance for micro air vehicles using an egocylindrical image space representation , 2016, Defense + Security.

[99]  Antonio M. López,et al.  Embedded Real-time Stereo Estimation via Semi-Global Matching on the GPU , 2016, ICCS.

[100]  Zhiyu Xiang,et al.  Perception in Disparity: An Efficient Navigation Framework for Autonomous Vehicles With Stereo Cameras , 2015, IEEE Transactions on Intelligent Transportation Systems.

[101]  Hugo J Spiers,et al.  A navigational guidance system in the human brain , 2007, Hippocampus.

[102]  Torsten Bertram,et al.  Trajectory modification considering dynamic constraints of autonomous robots , 2012, ROBOTIK.

[103]  Neil Robertson,et al.  Combining a modified vector field histogram algorithm and real-time image processing for unknown environment navigation , 2009, Electronic Imaging.

[104]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.