Pose estimation for planar contact manipulation with manifold particle filters

We investigate the problem of using contact sensors to estimate the pose of an object during planar pushing by a fixed-shape hand. Contact sensors are unique because they inherently discriminate between “contact” and “no-contact” configurations. As a result, the set of object configurations that activates a sensor constitutes a lower-dimensional contact manifold in the configuration space of the object. This causes conventional state estimation methods, such as the particle filter, to perform poorly during periods of contact due to particle starvation. In this paper, we introduce the manifold particle filter as a principled way of solving the state estimation problem when the state moves between multiple manifolds of different dimensionality. The manifold particle filter avoids particle starvation during contact by adaptively sampling particles that reside on the contact manifold from the dual proposal distribution. We describe three techniques, one analytical and two sample-based, of sampling from the dual proposal distribution and compare their relative strengths and weaknesses. We present simulation results that show that all three techniques outperform the conventional particle filter in both speed and accuracy. In addition, we implement the manifold particle filter on a real robot and show that it successfully tracks the pose of a pushed object using commercially available tactile sensors.

[1]  D. Blackwell Conditional Expectation and Unbiased Sequential Estimation , 1947 .

[2]  E. Hewitt,et al.  On the fundamental ideas of measure theory , 1962 .

[3]  V. A. Epanechnikov Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[4]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  B. Silverman,et al.  Using Kernel Density Estimates to Investigate Multimodality , 1981 .

[7]  Tomás Lozano-Pérez,et al.  Spatial Planning: A Configuration Space Approach , 1983, IEEE Transactions on Computers.

[8]  Peter Allen Surface descriptions from vision and touch , 1984, ICRA.

[9]  Matthew T. Mason,et al.  Mechanics and Planning of Manipulator Pushing Operations , 1986 .

[10]  Hendrik Van Brussel,et al.  Compliant Robot Motion I. A Formalism for Specifying Compliant Motion Tasks , 1988, Int. J. Robotics Res..

[11]  Hendrik Van Brussel,et al.  Compliant Robot Motion II. A Control Approach Based on External Control Loops , 1988, Int. J. Robotics Res..

[12]  Randy C. Brost,et al.  Automatic Grasp Planning in the Presence of Uncertainty , 1988, Int. J. Robotics Res..

[13]  John Kenneth Salisbury,et al.  Preliminary design of a whole-arm manipulation system (WAMS) , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[14]  Kazuo Tanie,et al.  Manipulation And Active Sensing By Pushing Using Tactile Feedback , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Alan E. Gelfand,et al.  Bayesian statistics without tears: A sampling-resampling perspective , 1992 .

[16]  Jing Xiao,et al.  Automatic determination of topological contacts in the presence of sensing uncertainties , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[17]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[18]  Chris Harris,et al.  Geometry from visual motion , 1993 .

[19]  Kevin M. Lynch,et al.  Pulling by Pushing, Slip With Infinite Friction, and Perfectly Rough Surfaces , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[20]  Jeffrey C. Trinkle,et al.  On the geometry of contact formation cells for systems of polygons , 1995, IEEE Trans. Robotics Autom..

[21]  Kevin M. Lynch,et al.  Stable Pushing: Mechanics, Controllability, and Planning , 1995, Int. J. Robotics Res..

[22]  Mark R. Cutkosky,et al.  Practical Force-Motion Models for Sliding Manipulation , 1996, Int. J. Robotics Res..

[23]  Michael L. Littman,et al.  Algorithms for Sequential Decision Making , 1996 .

[24]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[25]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[26]  Matthew T. Mason,et al.  Posing Polygonal Objects in the Plane by Pushing , 1998, Int. J. Robotics Res..

[27]  Yan-Bin Jia,et al.  Pose and Motion from Contact , 1999, Int. J. Robotics Res..

[28]  S. Resnick A Probability Path , 1999 .

[29]  Michael C. Ferris,et al.  Interfaces to PATH 3.0: Design, Implementation and Usage , 1999, Comput. Optim. Appl..

[30]  Wolfram Burgard,et al.  Monte Carlo Localization with Mixture Proposal Distribution , 2000, AAAI/IAAI.

[31]  Hong Zhang,et al.  Control of contact via tactile sensing , 2000, IEEE Trans. Robotics Autom..

[32]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[33]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[34]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[35]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[36]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[37]  Tim Hesterberg,et al.  Monte Carlo Strategies in Scientific Computing , 2002, Technometrics.

[38]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[40]  Dinesh Manocha,et al.  Accurate Minkowski sum approximation of polyhedral models , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[41]  Herman Bruyninckx,et al.  Bayesian Hybrid Model-State Estimation Applied to Simultaneous Contact Formation Recognition and Geometrical Parameter Estimation , 2005, Int. J. Robotics Res..

[42]  Bruno Pelletier Kernel density estimation on Riemannian manifolds , 2005 .

[43]  Maria Chiara Carrozza,et al.  Bio-inspired approach for the design and characterization of a tactile sensory system for a cybernetic prosthetic hand , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[44]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[45]  Joris De Schutter,et al.  Contact-State Segmentation Using Particle Filters for Programming by Human Demonstration in Compliant-Motion Tasks , 2007, IEEE Transactions on Robotics.

[46]  Nan Rong,et al.  What makes some POMDP problems easy to approximate? , 2007, NIPS.

[47]  T. Mörwald Edge Tracking of Textured Objects with a Recursive Particle Filter , 2009 .

[48]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  Kaijen Hsiao,et al.  Relatively robust grasping , 2009, ICAPS 2009.

[50]  Craig Corcoran Tracking object pose and shape during robot manipulation based on tactile information , 2009 .

[51]  Siddhartha S. Srinivasa,et al.  Planning pre-grasp manipulation for transport tasks , 2010, 2010 IEEE International Conference on Robotics and Automation.

[52]  S. Srinivasa,et al.  Push-grasping with dexterous hands: Mechanics and a method , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Robert Platt,et al.  Null-Space Grasp Control: Theory and Experiments , 2010, IEEE Transactions on Robotics.

[54]  Tamim Asfour,et al.  Representation of pre-grasp strategies for object manipulation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[55]  Rustam Stolkin,et al.  Motion estimation using physical simulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[56]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[57]  Russ Tedrake,et al.  Simultaneous localization and grasping using belief space planning , 2011 .

[58]  Richard A. Davis,et al.  Remarks on Some Nonparametric Estimates of a Density Function , 2011 .

[59]  Siddhartha S. Srinivasa,et al.  A Framework for Push-Grasping in Clutter , 2011, Robotics: Science and Systems.

[60]  Stefan Schaal,et al.  Online movement adaptation based on previous sensor experiences , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Takeo Igarashi,et al.  Automatic learning of pushing strategy for delivery of irregular-shaped objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[62]  Rustam Stolkin,et al.  Physical simulation for monocular 3D model based tracking , 2011, 2011 IEEE International Conference on Robotics and Automation.

[63]  Wolfram Burgard,et al.  Tactile Sensing for Mobile Manipulation , 2011, IEEE Transactions on Robotics.

[64]  Akansel Cosgun,et al.  Push planning for object placement on cluttered table surfaces , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[65]  L. Kaelbling,et al.  Simultaneous Localization and Grasping as a Belief Space Control Problem , 2011 .

[66]  Damien Jade Duff,et al.  Visual motion estimation and tracking of rigid bodies by physical simulation , 2011 .

[67]  Siddhartha S. Srinivasa,et al.  Physics-Based Grasp Planning Through Clutter , 2012, Robotics: Science and Systems.

[68]  J. A. Fishel,et al.  Sensing tactile microvibrations with the BioTac — Comparison with human sensitivity , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[69]  Siddhartha S. Srinivasa,et al.  A Planning Framework for Non-Prehensile Manipulation under Clutter and Uncertainty , 2012, Autonomous Robots.

[70]  Martial Hebert,et al.  An integrated system for autonomous robotics manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[71]  Claudio Zito,et al.  Two-level RRT planning for robotic push manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[72]  Jeffrey C. Trinkle,et al.  The application of particle filtering to grasping acquisition with visual occlusion and tactile sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[73]  Ross A. Knepper,et al.  Herb 2.0: Lessons Learned From Developing a Mobile Manipulator for the Home , 2012, Proceedings of the IEEE.

[74]  Nicholas Roy,et al.  A Framework for Push-Grasping in Clutter , 2012 .

[75]  Joel W. Burdick,et al.  The next best touch for model-based localization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[76]  Danfei Xu,et al.  Tactile identification of objects using Bayesian exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[77]  Siddhartha S. Srinivasa,et al.  Manifold Representations for State Estimation in Contact Manipulation , 2013, ISRR.

[78]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[79]  Li Zhang,et al.  Physics-empowered perception for robot grasping and dexterous manipulation , 2013 .

[80]  Siddhartha S. Srinivasa,et al.  Efficient touch based localization through submodularity , 2012, 2013 IEEE International Conference on Robotics and Automation.

[81]  Siddhartha S. Srinivasa,et al.  Pregrasp Manipulation as Trajectory Optimization , 2013, Robotics: Science and Systems.

[82]  Helge J. Ritter,et al.  A Control Framework for Tactile Servoing , 2013, Robotics: Science and Systems.

[83]  Jeffrey C. Trinkle,et al.  A dynamic Bayesian approach to real-time estimation and filtering in grasp acquisition , 2013, 2013 IEEE International Conference on Robotics and Automation.

[84]  Joel W. Burdick,et al.  Interactive non-prehensile manipulation for grasping via POMDPs , 2013, 2013 IEEE International Conference on Robotics and Automation.

[85]  Siddhartha S. Srinivasa,et al.  Pose estimation for contact manipulation with manifold particle filters , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[86]  Jeannette Bohg,et al.  Three-dimensional object reconstruction of symmetric objects by fusing visual and tactile sensing , 2014, Int. J. Robotics Res..

[87]  Siddhartha S. Srinivasa,et al.  Pre- and post-contact policy decomposition for planar contact manipulation under uncertainty , 2014, Int. J. Robotics Res..

[88]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[89]  Siddhartha S. Srinivasa,et al.  Pre- and post-contact policy decomposition for planar contact manipulation under uncertainty , 2014, Int. J. Robotics Res..

[90]  J. Trinkle,et al.  A Dynamic Bayesian Approach to Simultaneous Estimation and Filtering in Grasp Acquisition , .