Efficient Belief Space Planning in High-Dimensional State Spaces using PIVOT: Predictive Incremental Variable Ordering Tactic

In this work, we examine the problem of online decision making under uncertainty, which we formulate as planning in the belief space. Maintaining beliefs (i.e., distributions) over high-dimensional states (e.g., entire trajectories) was not only shown to significantly improve accuracy, but also allows planning with information-theoretic objectives, as required for the tasks of active SLAM and information gathering. Nonetheless, planning under this “smoothing” paradigm holds a high computational complexity, which makes it challenging for online solution. Thus, we suggest the following idea: before planning, perform a standalone state variable reordering procedure on the initial belief, and “push forwards” all the predicted loop closing variables. Since the initial variable order determines which subset of them would be affected by incoming updates, such reordering allows us to minimize the total number of affected variables, and reduce the computational complexity of candidate evaluation during planning. We call this approach PIVOT: Predictive Incremental Variable Ordering Tactic. Applying this tactic can also improve the state inference efficiency; if we maintain the PIVOT order after the planning session, then we should similarly reduce the cost of loop closures, when they actually occur. To demonstrate its effectiveness, we applied PIVOT in a realistic active SLAM simulation, where we managed to significantly reduce the computation time of both the planning and inference sessions. The approach is applicable to general distributions, and induces no loss in accuracy.

[1]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[2]  R. Tarjan,et al.  The analysis of a nested dissection algorithm , 1987 .

[3]  Timothy A. Davis,et al.  A column approximate minimum degree ordering algorithm , 2000, TOMS.

[4]  Pieter Abbeel,et al.  Scaling up Gaussian Belief Space Planning Through Covariance-Free Trajectory Optimization and Automatic Differentiation , 2014, WAFR.

[5]  Viorela Ila,et al.  SLAM++ 1 -A highly efficient and temporally scalable incremental SLAM framework , 2017, Int. J. Robotics Res..

[6]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[7]  Ryan M. Eustice,et al.  Active visual SLAM for robotic area coverage: Theory and experiment , 2015, Int. J. Robotics Res..

[8]  Leslie Pack Kaelbling,et al.  Belief space planning assuming maximum likelihood observations , 2010, Robotics: Science and Systems.

[9]  Tinkara Toš,et al.  Graph Algorithms in the Language of Linear Algebra , 2012, Software, environments, tools.

[10]  N. Roy,et al.  The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance , 2009, Int. J. Robotics Res..

[11]  Lydia E. Kavraki,et al.  A heuristic approach to finding diverse short paths , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Blai Bonet,et al.  Planning with Incomplete Information as Heuristic Search in Belief Space , 2000, AIPS.

[13]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[14]  F. Dellaert Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .

[15]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.

[16]  Vadim Indelman,et al.  Scalable sparsification for efficient decision making under uncertainty in high dimensional state spaces , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Vadim Indelman,et al.  General-purpose incremental covariance update and efficient belief space planning via a factor-graph propagation action tree , 2019, Int. J. Robotics Res..

[18]  Nancy M. Amato,et al.  SLAP: Simultaneous Localization and Planning Under Uncertainty via Dynamic Replanning in Belief Space , 2018, IEEE Transactions on Robotics.

[19]  Sebastian Thrun,et al.  Monte Carlo POMDPs , 1999, NIPS.

[20]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[21]  Wolfram Burgard,et al.  Exploration with active loop-closing for FastSLAM , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[22]  F. Dellaert,et al.  Exploiting Locality by Nested Dissection For Square Root Smoothing and Mapping , 2005 .

[23]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Vadim Indelman,et al.  No belief propagation required: Belief space planning in high-dimensional state spaces via factor graphs, the matrix determinant lemma, and re-use of calculation , 2017, Int. J. Robotics Res..

[25]  Jonathan P. How,et al.  Decision Making Under Uncertainty: Theory and Application , 2015 .

[26]  Ryan M. Eustice,et al.  Efficient planning with the Bayes tree for active SLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[28]  Shashank Pathak,et al.  A unified framework for data association aware robust belief space planning and perception , 2018, Int. J. Robotics Res..

[29]  Simplified decision making in the belief space using belief sparsification , 2019, 1909.00885.

[30]  V. Indelman,et al.  Introducing PIVOT: Predictive Incremental Variable Ordering Tactic for Efficient Belief Space Planning , 2019, ISRR.

[31]  Andreas Krause,et al.  Advances in Neural Information Processing Systems (NIPS) , 2014 .

[32]  Frank Dellaert,et al.  The Bayes Tree: Enabling Incremental Reordering and Fluid Relinearization for Online Mapping , 2010 .

[33]  Vadim Indelman,et al.  Efficient Modification of the Upper Triangular Square Root Matrix on Variable Reordering , 2021, IEEE Robotics and Automation Letters.

[34]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[35]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[36]  M. Yannakakis Computing the Minimum Fill-in is NP^Complete , 1981 .

[37]  R. C. Coulter,et al.  Implementation of the Pure Pursuit Path Tracking Algorithm , 1992 .

[38]  Edwin Olson,et al.  Variable reordering strategies for SLAM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Vadim Indelman,et al.  Towards efficient inference update through planning via JIP — Joint inference and belief space planning , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Frank Dellaert,et al.  Factor Graphs for Robot Perception , 2017, Found. Trends Robotics.