Pose estimation for contact manipulation with manifold particle filters

We investigate the problem of estimating the state of an object during manipulation. Contact sensors provide valuable information about the object state during actions which involve persistent contact, e.g. pushing. However, contact sensing is very discriminative by nature, and therefore the set of object states that contact a sensor constitutes a lower-dimensional manifold in the state space of the object. This causes stochastic state estimation methods, such as particle filters, to perform poorly when contact sensors are used. We propose a new algorithm, the manifold particle filter, which uses dual particles directly sampled from the contact manifold to avoid this problem. The algorithm adapts to the probability of contact by dynamically changing the number of dual particles sampled from the manifold. We compare our algorithm to the conventional particle filter through extensive experiments and we show that our algorithm is both faster and better at estimating the state. Unlike the conventional particle filter, our algorithm's performance improves with increasing sensor accuracy and the filter's update rate. We implement the algorithm on a real robot using commercially available tactile sensors to track the pose of a pushed object.

[1]  D. Blackwell Conditional Expectation and Unbiased Sequential Estimation , 1947 .

[2]  M. Rosenblatt Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[3]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[4]  V. A. Epanechnikov Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[5]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  B. Silverman,et al.  Using Kernel Density Estimates to Investigate Multimodality , 1981 .

[8]  Peter Allen Surface descriptions from vision and touch , 1984, ICRA.

[9]  Matthew T. Mason,et al.  Mechanics and Planning of Manipulator Pushing Operations , 1986 .

[10]  Randy C. Brost,et al.  Automatic Grasp Planning in the Presence of Uncertainty , 1988, Int. J. Robotics Res..

[11]  John Kenneth Salisbury,et al.  Preliminary design of a whole-arm manipulation system (WAMS) , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[12]  Tomás Lozano-Pérez,et al.  Spatial Planning: A Configuration Space Approach , 1983, IEEE Transactions on Computers.

[13]  Kazuo Tanie,et al.  Manipulation And Active Sensing By Pushing Using Tactile Feedback , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Alan E. Gelfand,et al.  Bayesian statistics without tears: A sampling-resampling perspective , 1992 .

[15]  Matthew T. Mason,et al.  Posing Polygonal Objects in the Plane by Pushing , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[16]  Jing Xiao,et al.  Automatic determination of topological contacts in the presence of sensing uncertainties , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[17]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[18]  Chris Harris,et al.  Geometry from visual motion , 1993 .

[19]  Kevin M. Lynch,et al.  Pulling by Pushing, Slip With Infinite Friction, and Perfectly Rough Surfaces , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[20]  Jeffrey C. Trinkle,et al.  On the geometry of contact formation cells for systems of polygons , 1995, IEEE Trans. Robotics Autom..

[21]  Kevin M. Lynch,et al.  Stable Pushing: Mechanics, Controllability, and Planning , 1995, Int. J. Robotics Res..

[22]  Mark R. Cutkosky,et al.  Practical Force-Motion Models for Sliding Manipulation , 1996, Int. J. Robotics Res..

[23]  Michael L. Littman,et al.  Algorithms for Sequential Decision Making , 1996 .

[24]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[25]  Yan-Bin Jia,et al.  Pose and Motion from Contact , 1999, Int. J. Robotics Res..

[26]  S. Resnick A Probability Path , 1999 .

[27]  Michael C. Ferris,et al.  Interfaces to PATH 3.0: Design, Implementation and Usage , 1999, Comput. Optim. Appl..

[28]  Wolfram Burgard,et al.  Monte Carlo Localization with Mixture Proposal Distribution , 2000, AAAI/IAAI.

[29]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[30]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[31]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Sebastian Thrun,et al.  FastSLAM 2.0: An Improved Particle Filtering Algorithm for Simultaneous Localization and Mapping that Provably Converges , 2003, IJCAI.

[33]  Dinesh Manocha,et al.  Accurate Minkowski sum approximation of polyhedral models , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[34]  Herman Bruyninckx,et al.  Bayesian Hybrid Model-State Estimation Applied to Simultaneous Contact Formation Recognition and Geometrical Parameter Estimation , 2005, Int. J. Robotics Res..

[35]  Bruno Pelletier Kernel density estimation on Riemannian manifolds , 2005 .

[36]  Maria Chiara Carrozza,et al.  Bio-inspired approach for the design and characterization of a tactile sensory system for a cybernetic prosthetic hand , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[37]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[38]  Joris De Schutter,et al.  Contact-State Segmentation Using Particle Filters for Programming by Human Demonstration in Compliant-Motion Tasks , 2007, IEEE Transactions on Robotics.

[39]  Nan Rong,et al.  What makes some POMDP problems easy to approximate? , 2007, NIPS.

[40]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[41]  Kaijen Hsiao,et al.  Relatively robust grasping , 2009, ICAPS 2009.

[42]  Siddhartha S. Srinivasa,et al.  Planning pre-grasp manipulation for transport tasks , 2010, 2010 IEEE International Conference on Robotics and Automation.

[43]  S. Srinivasa,et al.  Push-grasping with dexterous hands: Mechanics and a method , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Robert Platt,et al.  Null-Space Grasp Control: Theory and Experiments , 2010, IEEE Transactions on Robotics.

[45]  Tamim Asfour,et al.  Representation of pre-grasp strategies for object manipulation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[46]  Rustam Stolkin,et al.  Motion estimation using physical simulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[47]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[48]  Siddhartha S. Srinivasa,et al.  A Framework for Push-Grasping in Clutter , 2011, Robotics: Science and Systems.

[49]  Stefan Schaal,et al.  Online movement adaptation based on previous sensor experiences , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Takeo Igarashi,et al.  Automatic learning of pushing strategy for delivery of irregular-shaped objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[51]  Rustam Stolkin,et al.  Physical simulation for monocular 3D model based tracking , 2011, 2011 IEEE International Conference on Robotics and Automation.

[52]  Wolfram Burgard,et al.  Tactile Sensing for Mobile Manipulation , 2011, IEEE Transactions on Robotics.

[53]  Akansel Cosgun,et al.  Push planning for object placement on cluttered table surfaces , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Siddhartha S. Srinivasa,et al.  Physics-Based Grasp Planning Through Clutter , 2012, Robotics: Science and Systems.

[55]  Siddhartha S. Srinivasa,et al.  A Planning Framework for Non-Prehensile Manipulation under Clutter and Uncertainty , 2012, Autonomous Robots.

[56]  Martial Hebert,et al.  An integrated system for autonomous robotics manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[57]  Claudio Zito,et al.  Two-level RRT planning for robotic push manipulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[58]  Dieter Fox,et al.  Interactive singulation of objects from a pile , 2012, 2012 IEEE International Conference on Robotics and Automation.

[59]  Jeffrey C. Trinkle,et al.  The application of particle filtering to grasping acquisition with visual occlusion and tactile sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[60]  Gaurav S. Sukhatme,et al.  Using manipulation primitives for brick sorting in clutter , 2012, 2012 IEEE International Conference on Robotics and Automation.

[61]  Ross A. Knepper,et al.  Herb 2.0: Lessons Learned From Developing a Mobile Manipulator for the Home , 2012, Proceedings of the IEEE.

[62]  Joel W. Burdick,et al.  The next best touch for model-based localization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[63]  Siddhartha S. Srinivasa,et al.  Manifold Representations for State Estimation in Contact Manipulation , 2013, ISRR.

[64]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[65]  Li Zhang,et al.  Physics-empowered perception for robot grasping and dexterous manipulation , 2013 .

[66]  Siddhartha S. Srinivasa,et al.  Efficient touch based localization through submodularity , 2012, 2013 IEEE International Conference on Robotics and Automation.

[67]  Jeffrey C. Trinkle,et al.  A dynamic Bayesian approach to real-time estimation and filtering in grasp acquisition , 2013, 2013 IEEE International Conference on Robotics and Automation.

[68]  Joel W. Burdick,et al.  Interactive non-prehensile manipulation for grasping via POMDPs , 2013, 2013 IEEE International Conference on Robotics and Automation.

[69]  Jeannette Bohg,et al.  Three-dimensional object reconstruction of symmetric objects by fusing visual and tactile sensing , 2014, Int. J. Robotics Res..

[70]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[71]  J. Trinkle,et al.  A Dynamic Bayesian Approach to Simultaneous Estimation and Filtering in Grasp Acquisition , .